NVIDIA NIM Optimizations Boost Nemotron 3 Ultra Throughput by 2.5x on B200 Systems

NVIDIA's NIM microservice stack optimized Nemotron 3 Ultra on 4x B200 systems, increasing system throughput from 718 to 1,997 tok/s. Under a fixed latency SLO of 50 tok/s per user, the same hardware can serve about 2.78x more concurrent users.