Glossary · Objects and system context
Evaluator construction stack
How an evaluation is built: construct, specification, mechanism, signal, and use, with resolution and deployment context cutting across. It records how the evaluator was engineered, a separate question from the verification hierarchy's evidential strength.
Also called: design stack
Defined in
Handbook · FoundationsVocabulary without category errorsReward model, rubric, PRM, RLHF, verifier: put each term on the axis it actually describes and most confusions disappear.Related terms
- Verification hierarchy
- Formal verification > execution feedback > learned judges > intrinsic signals: a prior over expected grounding strength, not a verdict on validity. Human judgment sits outside the ladder as the external frontier and trust root.
- Six-axis evaluator type
- The tuple ⟨C, Ψ, M, Z, R, U⟩ — construct, specification, mechanism, signal, resolution, use — that describes an evaluator by its value on every axis instead of a single noun. The framework distributes it across E_sys.