Glossary · Evaluator mechanisms
Human rater or panel
A human measurement mechanism whose reliability, expertise, and disagreement should be characterized rather than assumed infallible.
Defined in
Handbook · InstrumentMechanism familiesProof checkers, executors, rule engines, learned judges, intrinsic signals and people: what each can guarantee, and what each can only estimate.Related terms
- Trust root (reference authority)
- Where the evaluate-the-evaluator chain stops: a configured proof kernel, or an expert panel with measured reliability and a governance mandate.
Where it comes up
- The verification hierarchy, demotedHandbook · Foundations
- Reliability and generalizabilityHandbook · Validation
- CrosswalkHandbook · Reference