Skip to content
Tech

Why do I only find out I tagged a metric wrong when the invoice arrives?

82

Möglichkeit

Tagging a metric with a high-cardinality attribute like a user ID, session ID, or request path multiplies a single time-series into hundreds of millions, and the bill follows a week later rather than a CI failure follows a minute later. By 2026, observability spend has reached 15 to 25 percent of total cloud spend at affected SaaS companies, with documented single-service incidents generating $90,000 in charges over a weekend. Every major backend, including Datadog, Grafana Cloud, and Prometheus, detects cardinality explosions only after ingestion, meaning the only signal is a budget alert or an invoice line item, not a pull request annotation. The OpenTelemetry SDK added optional cardinality caps in early 2026, but these are runtime circuit-breakers that silently drop data rather than upstream gates that catch the problem before it ships. There is no widely adopted CI primitive that ana

Warum es wichtig ist

Every engineer who has tagged a metric with a user ID has had a bad Tuesday; catching it at the pull request instead of on the invoice permanently changes the economics of instrumentation.

Wie ich die Chance bewerte

Der Opportunity Score ist meine persönliche Einschätzung, keine Messung: wie stark es schmerzt, wie oft es auftritt und wie wenig heute existiert, um es zu lösen. Ein höherer Wert bedeutet, dass ich es für lohnender halte, es umzusetzen.

Schweregrad8/10

Wie viel Schmerz es verursacht, wenn es auftritt.

Häufigkeit8/10

Wie oft Menschen tatsächlich darauf stoßen.

Whitespace8/10

Wie wenig gute Werkzeuge dafür heute existieren.

Weitere lösungswürdige Probleme