You make LLM tracing and evaluation pay off in production by treating the trace — not the HTTP request, and not the prompt — as the unit of quality. Emit one instrumented span per logical model call, attach automated evaluations to a sampled slice of those traces, and alert on …