Glossary · Optimization and failure dynamics
Grader gaming (bypass)
2InstrumentA candidate satisfies the scorer without doing the intended work: hard-coded answers, fabricated citations, edited tests. Red-team the grader and constrain the routes to a pass.
Also called: bypass, grader bypass
Defined in
Handbook · PracticeAnti-patterns and failure vocabularySeventeen named ways evaluator systems fail, each with its tell, its layer and its fix.Related terms
- Reward hacking
- Behavior that obtains high measured reward while violating the intended objective; a special case of evaluator exploitation.