Glossary · Objects and system context
Validation triad
The system under test, the environment it acts in, and the specification its behavior is checked against. It exposes two structural failures: faithfully measuring the wrong world, and faithfully checking the wrong property.
Also called: system–environment–specification triad, wrong world, wrong property
Defined in
Handbook · FoundationsEvaluation is measurementA score is an observation, not a capability. Follow the instrument chain from construct to decision and the four places error gets in.Related terms
- System under test (SUT)
- The model, policy, or agent, plus the relevant observation and action pipeline, whose behavior is being measured.
- Environment
- External state and transition process the system interacts with; may be simulated, sandboxed, pinned, or live.
- Specification
- The operational statement of success or acceptable behavior: formal, executable, rubric-based, preference-based, or state-based.