NVIDIA Agora: 13 AI Agents Collaborate via Git DAG to Solve Research Task

NVIDIA's Agora system enabled 13 AI agents to collaborate on a weight-transfer research task over 12 days using a Git-based directed acyclic graph. The agents reduced the metric from 3.392 to 1.899 bpb (62% of gap to trained GPT-2) and discovered that transferring behavioral (bigram) statistics across architectures works better than transferring parameters.