← Curriculum
Advanced
~17 minobservability
drift
production
Drift, observability, and the production loop
Pre-launch evals are necessary; production telemetry is sufficient.
Step 1 of 13
An eval set is a snapshot. Production is a stream. The job of production observability is to detect when the live distribution of inputs, outputs, or quality drifts away from what your eval set covers — and to feed that signal back into evals.