Boltzbit and Cambridge Propose Dynamic Weight Writing for LLMs
Boltzbit and Cambridge researchers proposed dynamically writing knowledge into model weights via a hypernetwork. This 'infinite parameters' approach generates LoRA weights on the fly, outperforming traditional methods in long-document and multi-turn scenarios with constant per-turn compute costs.