XNews

NVIDIA explains MoE models: 30B parameters, 3B activated per token

NVIDIA explains MoE models: 30B parameters, 3B activated per token

NVIDIA released a technical explainer detailing how mixture-of-experts (MoE) models activate only 3B of 30B parameters per token, and the implications for throughput, memory, and serving complexity.

Source posts