Boltzbit and Cambridge propose dynamic weight updates for LLMs
Boltzbit and Cambridge University developed a method to write knowledge into model weights dynamically using a hypernetwork and Bayesian mechanism. This 'infinite parameter' approach generates low-rank LoRA weights on the fly, outperforming traditional context window methods in long documents and multi-turn dialogues.