Skip to content
AI

Why does TLS not actually hide what I am asking my AI assistant?

80

Opportunity

Streaming LLM responses emit tokens one at a time over an encrypted connection, and each packet arrival changes size and timing in ways that correlate with topic. The Whisper Leak paper published in November 2025 demonstrated topic classification with above 98% AUPRC across 28 major providers using only encrypted traffic metadata. Several providers issued patches but each mitigation trades query privacy for added latency and there is no agreed specification for what a sufficient defense looks like. The structural problem is that any low-latency streaming protocol leaks information through timing, so padding and noise are palliatives rather than solutions.

Why it matters

Every enterprise using a hosted LLM for sensitive work is operating under a false assumption about what TLS protects, and the fix requires rethinking the streaming transport layer itself.

How I score the opportunity

The Opportunity Score is my own read, not a measurement: how much it hurts, how often it bites, and how little exists to solve it today. Higher means I think it is more worth building.

Severity8/10

How much pain it causes when it shows up.

Frequency8/10

How often people actually run into it.

Whitespace7/10

How little good tooling exists for it today.

More problems worth solving