Skip to content
Benchmaker

Glossary · Objects and system context

Category error

Treating objects that describe different axes — a specification, a mechanism, a resolution, a use — as peers on one list, as in ranking a rubric against a reward model or calling RLHF an evaluator.

Defined in

Handbook · FoundationsVocabulary without category errorsReward model, rubric, PRM, RLHF, verifier: put each term on the axis it actually describes and most confusions disappear.
Six-axis evaluator type
The tuple ⟨C, Ψ, M, Z, R, U⟩ — construct, specification, mechanism, signal, resolution, use — that describes an evaluator by its value on every axis instead of a single noun. The framework distributes it across E_sys.

See it in the full glossary →