Glossary · Validity and evidence
Consequential evidence
4ValidationEvidence about what happens because a score is used: once it becomes a gate, leaderboard target, or reward, does optimization against it degrade the relation between score and construct?
Defined in
Handbook · ValidationSources of validity evidenceFace, content, response-process, internal-structure, convergent, discriminant and criterion evidence, plus the multitrait–multimethod design.Related terms
- Goodhart pressure
- Degradation of the proxy-to-construct relation caused by optimization against the proxy.