Glossary · Use and training pipelines
DPO
Direct preference optimization: trains directly from preference pairs without a separately optimized reward-model-plus-RL loop. It changes the optimizer, not the measurement problem.
Defined in
Handbook · RegimeEvaluators inside training loopsRLHF is a pipeline, not an evaluator. Where the learned judge sits in RLHF, RLAIF, RLVR and DPO, and what it is exposed to.Where it comes up
- Vocabulary without category errorsHandbook · Foundations