Glossary · Meaning and specification
Inverse reward design
Treats a hand-written reward as evidence about its designer's true objective, given the situations it was designed for. Evaluation analogue: a rubric or benchmark score is evidence about what its designer meant to measure, not the construct itself.
Defined in
Handbook · PracticeInverse evaluation designTreat expert accept/reject decisions as evidence about a latent judgment, and use the posterior to find criteria, thresholds and the questions worth asking.Related terms
- Inverse evaluation design
- A proposed research program that treats expert preferences, corrections, escalations, rubric edits, and accept/reject decisions as evidence of a latent judgment and infers its criteria, weights, gates, and thresholds.