Half-Price Tokens: Batch Inference for Async Workloads

October 21, 2026

Batch inference APIs sell you the same models at half price in exchange for latency you can budget for: results arrive in minutes or hours instead of milliseconds. Anthropic charges all batch usage at 50% of its standard synchronous API prices, and Amazon Bedrock bills batch inference at a 50% …