OpenAI's AI Models Automate Experimental Training, Including GPU Kernel Writing
OpenAI's internal AI models can now automate the training of new experimental models, including writing GPU kernels and optimizing training code. Researchers provide an optimization example, and the AI spends weeks implementing and testing improvements. Multiple AI agents collaborate without human involvement.