Glossary · Validity and evidence
Validation profileΠ
4ValidationThe measured profile Π = (N, E, T, G, C, D): natural error, exploitability, transport, generator coupling, channel coupling, drift. It replaces hierarchy labels with measurements.
Defined in
Handbook · Validity under pressureThe validation profile and validity statementReplace hierarchy labels with measurements, Π = (N, E, T, G, C, D), and ship every evaluator with a falsifiable statement of scope.Where it comes up
- The verification hierarchy, demotedHandbook · Foundations
- LLM judges in practiceHandbook · Instrument
- Evaluators inside training loopsHandbook · Regime
- The validity argumentHandbook · Validation
- The judge as a noisy sensorHandbook · Validation
- Adaptive validityHandbook · Validity under pressure
- Goodhart pressure and self-confirming loopsHandbook · Validity under pressure
- Channels, independence, and anchor burnHandbook · Lifecycle
- The One SpineHandbook · Practice
- Verifiability engineeringHandbook · Practice
- Auditing an evalHandbook · Practice
- A: Mathematical reasoningHandbook · Case studies
- B: Coding agentHandbook · Case studies
- C: Enterprise SQL/data agentHandbook · Case studies
- D: Autonomous research agentHandbook · Case studies
- E: Reasoning-model trainingHandbook · Case studies
- F: Production safety monitorHandbook · Case studies
- G: Documentation agentHandbook · Case studies
- CrosswalkHandbook · Reference
- The frameworkPage