Glossary · Evaluator mechanisms
Learned judge
A reward model, LLM judge, learned PRM, classifier, or other learned evaluator: a noisy semantic sensor whose error must be characterized.
Defined in
Handbook · InstrumentMechanism familiesProof checkers, executors, rule engines, learned judges, intrinsic signals and people: what each can guarantee, and what each can only estimate.Where it comes up
- Vocabulary without category errorsHandbook · Foundations
- LLM judges in practiceHandbook · Instrument
- Use regimes: same judge, four jobsHandbook · Regime
- Evaluators inside training loopsHandbook · Regime
- CrosswalkHandbook · Reference