We just landed some big infra upgrades for the Gemini Batch API:
• p95 latency decreased by 80% -p99 latency decreased by 68% • batch success rate is now >99.998% • 98% reduction in batch expirations • added support for partial batches
great work by the team to land this!!