Skip to content
Benchmaker

Glossary · Evaluator mechanisms

Hybrid portfolio

2Instrument

An evaluator that routes each criterion to the strongest affordable mechanism for it, such as structural checks, execution, a learned judge, or people, instead of one universal evaluator. Its assurance depends on how coupled its channels are.

Defined in

Handbook · InstrumentMechanism familiesProof checkers, executors, rule engines, learned judges, intrinsic signals and people: what each can guarantee, and what each can only estimate.
Channel coupling
Dependence among supposedly independent assurance channels, measured by joint miss rates: does one channel miss what the other misses? High coupling means the Swiss-cheese holes line up.

Where it comes up

See it in the full glossary →