NVIDIA NIM optimizations boost Nemotron 3 Ultra throughput 2.5x on B200 systems

NVIDIA's full-stack NIM optimizations increased Nemotron 3 Ultra throughput from 718 to 1,997 tok/s on 4×B200, serving 2.78x more concurrent users at 50 tok/s per user. Key optimizations include NVFP4 quantization, prefix caching, and speculative decoding.