Glossary · Optimization and failure dynamics
Eval theater
1ClaimEvaluation disconnected from decisions: scores are displayed but never change action. Write the decision first, and ask when the eval last changed one.
Defined in
Handbook · PracticeAnti-patterns and failure vocabularySeventeen named ways evaluator systems fail, each with its tell, its layer and its fix.Related terms
- Decision claim
- The decision the evidence is meant to change: deploy, gate, select, terminate, reward, or page a human.
Where it comes up
- Use regimes: same judge, four jobsHandbook · Regime
- Frame review and governanceHandbook · Lifecycle
- The frameworkPage