Why do models trained on today's web get progressively worse as AI writes more of it?
Opportunity
The web is now the primary training corpus for frontier models and is already saturated with AI-generated text that no deployed filter reliably catches. Research published across 2024 to 2026 shows that even a fraction of a percent of synthetic data in a training run triggers distributional collapse over successive generations, narrowing output diversity and degrading tail performance. The feedback loop is structural: models trained this year produce content that contaminates the corpus for next year's training run. Proposed mitigations such as source-level allowlists, watermark filters, and synthetic-data verifiers each have bypass vectors and none has been deployed at web-crawler scale. There is no agreed protocol for identifying and quarantining AI-generated training data before it enters a model.
Why it matters
A degrading shared training corpus sets a ceiling on every model built from public data, and that ceiling gets lower with each generation.
How I score the opportunity
The Opportunity Score is my own read, not a measurement: how much it hurts, how often it bites, and how little exists to solve it today. Higher means I think it is more worth building.
How much pain it causes when it shows up.
How often people actually run into it.
How little good tooling exists for it today.
More problems worth solving
Why does every AI app forget me the moment I close the tab?
AIWhy is learning a new field still gated by knowing what to ask?
AIWhy can a non-expert not verify what an AI just told them?
AIWhy do we test models on benchmarks but ship them on vibes?
AIWhy do AI agents have no memory of their own mistakes?
AIWhy can't I audit what a model was actually trained on?