Glossary · Evaluator mechanisms
Verifier
Strictly, an evaluator with a soundness guarantee relative to a formal specification. In loose usage it often means a deterministic or execution checker.
Defined in
Handbook · FoundationsVocabulary without category errorsReward model, rubric, PRM, RLHF, verifier: put each term on the axis it actually describes and most confusions disappear.Related terms
- Judge
- A learned or prompted evaluator without formal soundness guarantees. People who score are raters, panels, or adjudicators, not judges, in this handbook.
Where it comes up
- Evaluators inside training loopsHandbook · Regime