Schema-Valid LLM Output Still Gets 20% of Values Wrong

97% JSON Pass, 20% Wrong Values The Structured Output Benchmark (SOB), published in April 2026, evaluated 21 frontier LLMs on schema-constrained extraction tasks. The result that should stop you from shipping: every model clears 97%+ on JSON Pass Rate, but Value Accuracy — whether the extracted values are actually correct …