XNews

Infinite parameter LLM dynamically writes knowledge into weights

Researchers from Boltzbit and Cambridge propose an 'infinite parameter' LLM using a hypernetwork to generate LoRA weights from user data, replacing context window reliance. It improves multi-turn accuracy and keeps compute constant.

Source posts