Boltzbit and Cambridge Introduce 'Infinite Parameters' for Dynamic LLM Weight Updates
Boltzbit and Cambridge University propose a method to dynamically generate low-rank weights from user interactions, allowing LLMs to 'write knowledge into weights' instead of context window. This approach outperforms traditional prompting in long documents and multi-turn conversations, with constant compute cost per turn.