Glossary · Optimization and failure dynamics
Diversity collapse
Homogenization of behavior or tasks in self-play or self-generated-data loops, which reduces useful variation. Track diversity explicitly and refresh task sources.
Defined in
Handbook · Validity under pressureGoodhart pressure and self-confirming loopsReward hacking needs an exploit; self-confirmation needs only a shared blind spot. Tell them apart and measure the coupling behind both.Related terms
- Model collapse
- Recursive training on generated data degrades distributional quality or capability, starting with the tails of the distribution. Gate data and ground rewards externally.