Provisioned Throughput: Sizing Reserved AI Capacity

October 22, 2026

Provisioned throughput is a reservation against model-serving capacity: instead of paying per token on shared infrastructure, you pay a fixed rate for dedicated processing capacity held around the clock. The unit differs by provider — Provisioned Throughput Units (PTUs) on Azure, Generative AI Scale Units (GSUs) on Google — but …