XNews

Infinite Parameter LLM Writes Knowledge into Weights

Researchers from Boltzbit and Cambridge developed a method that dynamically compiles user interaction data into low-rank LoRA weights using a hypernetwork. This 'infinite parameter' approach allows models to incorporate new facts without prompt injection, achieving better accuracy in long documents and multi-turn conversations while keeping computational cost constant per round.

Source posts