Skip to content
Tech

Why do I only find out I tagged a metric wrong when the invoice arrives?

82

Opportunité

Tagging a metric with a high-cardinality attribute like a user ID, session ID, or request path multiplies a single time-series into hundreds of millions, and the bill follows a week later rather than a CI failure follows a minute later. By 2026, observability spend has reached 15 to 25 percent of total cloud spend at affected SaaS companies, with documented single-service incidents generating $90,000 in charges over a weekend. Every major backend, including Datadog, Grafana Cloud, and Prometheus, detects cardinality explosions only after ingestion, meaning the only signal is a budget alert or an invoice line item, not a pull request annotation. The OpenTelemetry SDK added optional cardinality caps in early 2026, but these are runtime circuit-breakers that silently drop data rather than upstream gates that catch the problem before it ships. There is no widely adopted CI primitive that ana

Pourquoi c'est important

Every engineer who has tagged a metric with a user ID has had a bad Tuesday; catching it at the pull request instead of on the invoice permanently changes the economics of instrumentation.

Comment j'évalue l'opportunité

Le Score d'Opportunité est mon évaluation personnelle, pas une mesure : l'intensité de la douleur, sa fréquence et le peu de solutions qui existent aujourd'hui. Plus il est élevé, plus je pense que le problème vaut la peine d'être résolu.

Gravité8/10

L'intensité de la douleur qu'il provoque lorsqu'il se manifeste.

Fréquence8/10

La fréquence à laquelle les gens y sont réellement confrontés.

Espace libre8/10

Le peu de bons outils qui existent pour y remédier aujourd'hui.

D'autres problèmes qui méritent d'être résolus