Glossary · Evaluator mechanisms
Metamorphic test
A test that checks a known relation between the outputs of related inputs rather than each output against a reference, so errors such as accidental result-set equivalence surface without a fresh anchor for every input.
Defined in
Handbook · Case studiesC: Enterprise SQL/data agentFormalize access policy, execute semantic consequences, judge only the residual. The SQL agent design end to end.Related terms
- Execution / effect checker
- An evaluator that runs code, compiles, simulates, queries state, or observes consequences. Grounded but incomplete: passing tests means no tested counterexample was found.
Where it comes up
- The frameworkPage