Glossary · Reliability, calibration, and statistics
Optional stopping
Checking a comparison repeatedly and stopping once it looks significant. Each look is another chance for noise to cross the threshold, so false positives inflate; use a fixed sample size or an explicitly sequential design.