Glossary · Reliability, calibration, and statistics
Family-wise false-alarm rate
The probability that at least one of m gates fires on a change that does nothing: 1 − (1 − α)^m for independent gates at level α, about 26% for six gates at α = .05.
Also called: family-wise error rate
Defined in
Handbook · ValidationComparing systemsPair tasks, count discordant pairs, size for the smallest difference that matters, and never let significance stand in for validity.Where it comes up
- Notation and formula cardHandbook · Reference
- Comparing two systems on the same tasksCalculator