Skip to content
Benchmaker

Glossary · Use and training pipelines

Information accessA_access

3Regime

What flows from the evaluator, reference anchor, or certification process back to the optimizer. Every revealed score, failure explanation, or hidden test spends independence; the anchor condition is A ∉ S with I(A → O) controlled.

Also called: access surface, information access surface

Defined in

Handbook · RegimeExposure, modification, and accessWho consumes the signal, who optimizes against it, how hard, what they can change, and what they can see.
Anchor burn
Loss of a holdout's or anchor channel's independence as its information is fed back into optimization. Track it in an anchor-burn ledger and refresh exposed items.
Modification surface
Everything the optimizing loop can change: policy, prompts, tools, harness, tests, rubric, judge prompt, judge weights, reference anchors, environment. Trusted bases belong to it whenever the optimizer can touch them.

Where it comes up

See it in the full glossary →