We just landed some big infra upgrades for the Gemini Batch API:
- p95 latency decreased by 80% -p99 latency decreased by 68% - batch success rate is now >;99.998% - 98% reduction in batch expirations - added support for partial batches
great work by the team to land this!!