Speculative decoding lets a large language model emit tokens faster by drafting candidates with a small, cheap model and verifying them in a single forward pass of the target. Google researchers measured a 2X-3X acceleration on T5-XXL with identical outputs, without retraining or architecture changes, and the technique now ships …