XNews

Infinite parameters LLM: dynamic weight writing via hypernetwork

Boltzbit and Cambridge researchers proposed a method to dynamically write knowledge into model weights using a hypernetwork, instead of relying on the context window. It generates LoRA-like weights from user input and evolves them with Bayesian mechanisms, showing gains in long documents and multi-turn conversations.

Source posts