Skip to content
Benchmaker

Glossary · Use and training pipelines

Modification surfaceS

3Regime

Everything the optimizing loop can change: policy, prompts, tools, harness, tests, rubric, judge prompt, judge weights, reference anchors, environment. Trusted bases belong to it whenever the optimizer can touch them.

Defined in

Handbook · RegimeExposure, modification, and accessWho consumes the signal, who optimizes against it, how hard, what they can change, and what they can see.
Configured trusted base
Everything a formal guarantee is relative to: permitted axioms, theorem statements, checker version, kernel configuration, environment assumptions, and whether the optimizer can modify any of them. The Goodhart boundary moves here rather than disappearing.
Information access
What flows from the evaluator, reference anchor, or certification process back to the optimizer. Every revealed score, failure explanation, or hidden test spends independence; the anchor condition is A ∉ S with I(A → O) controlled.

Where it comes up

See it in the full glossary →