Skip to content
Benchmaker

Glossary · Evaluator mechanisms

Structural control

2Instrument

A mechanism family that makes a configured bad state unreachable through read-only credentials, sandboxes, permissions, or allowlists, instead of measuring it. It sits off the verification ladder; the guarantee covers only the configured roles and paths.

Defined in

Handbook · InstrumentMechanism familiesProof checkers, executors, rule engines, learned judges, intrinsic signals and people: what each can guarantee, and what each can only estimate.
Structural guarantee
A property enforced by the system's construction (permissions, sandboxes, verified scaffold rules, or an output grammar), so a failure is unreachable rather than rare. It holds only for its configured trusted base.
Capability removal
Making an unsafe state unreachable by construction, with read-only credentials, egress allowlists, spend caps, or sandbox walls, so its failure probability is zero as a property of the configured system rather than an estimate.
Configured trusted base
Everything a formal guarantee is relative to: permitted axioms, theorem statements, checker version, kernel configuration, environment assumptions, and whether the optimizer can modify any of them. The Goodhart boundary moves here rather than disappearing.

Where it comes up

See it in the full glossary →