Glossary · Evaluator mechanisms
Reward model (RM)
A learned model that predicts preference or quality, typically as a scalar or pairwise estimate, and is often optimized against.
Defined in
Handbook · RegimeEvaluators inside training loopsRLHF is a pipeline, not an evaluator. Where the learned judge sits in RLHF, RLAIF, RLVR and DPO, and what it is exposed to.Where it comes up
- Vocabulary without category errorsHandbook · Foundations
- Mechanism familiesHandbook · Instrument
- Adaptive validityHandbook · Validity under pressure
- Goodhart pressure and self-confirming loopsHandbook · Validity under pressure
- Inverse evaluation designHandbook · Practice
- Notation and formula cardHandbook · Reference