XNews

Gemini Batch API cuts p95 latency 80% and adds partial-batch support

Gemini Batch API achieved large infra improvements: p95 latency down 80%, p99 down 68%; batch success rate >99.998%; 98% fewer batch expirations; added support for partial batches. Team credited for delivery.

Source posts