Glossary · Use and training pipelines
Runtime control
An evaluator that can block, reroute, escalate, or roll back deployed behavior, rather than only observe it.
Defined in
Handbook · RegimeMonitoring and control in productionMonitoring is not continuous benchmarking: base rates, calibration, conformal caveats, and the moment a monitor becomes a training signal.Where it comes up
- Use regimes: same judge, four jobsHandbook · Regime
- F: Production safety monitorHandbook · Case studies
- CrosswalkHandbook · Reference