Glossary · Reliability, calibration, and statistics
Calibration
Agreement between predicted confidence or score and empirical frequencies of correctness.
Defined in
Handbook · RegimeMonitoring and control in productionMonitoring is not continuous benchmarking: base rates, calibration, conformal caveats, and the moment a monitor becomes a training signal.Where it comes up
- Signals and resolutionHandbook · Instrument
- Reliability and generalizabilityHandbook · Validation
- F: Production safety monitorHandbook · Case studies