XNews

Ilya clarifies interview: scaling compute/data/training improves models but lacks a key element for other capabilities

Ilya clarified his interview: continuing to scale compute, data, and training will keep improving models and benchmarks; however, he emphasized that some important capability will remain missing regardless of scaling, implying intrinsic limits to current methods for achieving certain abilities.

Source posts