Glossary · Meaning and specification
Rubric soup
2InstrumentSeveral logically distinct criteria packed into one paragraph and scored by one judge on a single scale, so failures cannot be localized and compensation between criteria stays hidden. Its opposite error is rubric atomization.
Defined in
Handbook · InstrumentRubrics and criterion cardsA rubric is an intermediate representation, not a weak verifier. Compile tacit expertise into cards that send each criterion to its strongest mechanism.Related terms
- Rubric atomization
- Decomposition taken too far: dozens of micro-criteria whose combination no longer reproduces how experts decide. The right grain is the smallest set of independently meaningful criteria that still reconstructs the expert decision.
- Aggregation geometry
- The rule that combines criterion-level signals into a decision: weighted mean, conjunctive gate, lexicographic order, Pareto vector, or tail-risk rule.