Skip to content
Benchmaker

Glossary · Reliability, calibration, and statistics

Clustered trials

Repeated trials of the same task, whose outcomes are correlated. Treating n tasks × k trials as nk independent samples understates uncertainty; resample whole tasks or fit a hierarchical model.

Defined in

Handbook · ValidationEstimands, pass rates, and intervalsWrite the estimand first, then report n, an honest interval and the right functional, from Wilson to pass^k to reweighted estimates.

See it in the full glossary →