XNews

Boltzbit and Cambridge introduce dynamic weight updating for LLMs

Researchers proposed writing knowledge into model weights instead of prompts, using a hypernetwork to generate LoRA weights dynamically per conversation. This Bayesian mechanism allows the model to adapt continuously without repeatedly re-reading context. Experiments show superior performance on long documents, multi-turn dialogues, and constant compute cost per turn.

Source posts