Why does the model I use for evaluation prefer the model it came from?
Opportunity
LLM-as-judge has become the default way to run quality evaluations at scale, but judges from the same model family rate their own outputs 10 to 25 percent higher than equivalent outputs from a different family. Multiple 2025 and 2026 papers confirm the bias holds across position, verbosity, and rubric-constrained formats, and simple mitigations like panel voting reduce but do not eliminate it. Existing measurement frameworks cannot separate genuine quality differences from stylistic self-matching, so the effect cannot be corrected without first being cleanly isolated. Any team using the incumbent model to evaluate a replacement is running an evaluation with a structural thumb on the scale.
Why it matters
The entire AI improvement loop depends on honest quality signals, and a biased evaluator corrupts that signal at the source without raising any alert.
How I score the opportunity
The Opportunity Score is my own read, not a measurement: how much it hurts, how often it bites, and how little exists to solve it today. Higher means I think it is more worth building.
How much pain it causes when it shows up.
How often people actually run into it.
How little good tooling exists for it today.
More problems worth solving
Why does every AI app forget me the moment I close the tab?
AIWhy is learning a new field still gated by knowing what to ask?
AIWhy can a non-expert not verify what an AI just told them?
AIWhy do we test models on benchmarks but ship them on vibes?
AIWhy do AI agents have no memory of their own mistakes?
AIWhy can't I audit what a model was actually trained on?