Skip to content
Benchmaker

Glossary · Optimization and failure dynamics

Correlated trials

4Validation

Shared infrastructure, dependencies, or state make trial outcomes co-move, invalidating independent-sample uncertainty calculations. Isolate trials and resample at the task level.

Defined in

Handbook · PracticeAnti-patterns and failure vocabularySeventeen named ways evaluator systems fail, each with its tell, its layer and its fix.

See it in the full glossary →