XNews

Terence Tao on LLMs: Training is Simple, Competence is Unpredictable

Terence Tao on LLMs: Training is Simple, Competence is Unpredictable

Mathematician Terence Tao stated that the training of LLMs relies mainly on linear algebra and calculus, but why they succeed at some tasks and fail at others remains unpredictable. He noted that we know how to build models, but we are still exploring what they are actually capable of.

Source posts