Boltzbit & Cambridge unveil infinite parameter LLM via dynamic LoRA weights
Boltzbit and Cambridge researchers propose an 'infinite parameter' LLM that dynamically compiles user input into LoRA weights via a hypernetwork, bypassing the fixed context window. The method surpasses traditional approaches in long-document and multi-turn tasks, with constant computational cost per turn.