IICTPIICTP

Blog / Guides

Telemetry26 October 20265 min read

Observability costs too much: how teams cut telemetry spend without going blind

Telemetry grows faster than the system it describes unless someone manages it. The goal is not to collect less for its own sake, but to keep the data that helps you make decisions and drop the rest.

In this post
  1. Where the money goes
  2. Practical levers
  3. Stay safe
  4. Sources and further reading

Where the money goes

  • High-volume, low-value logs.
  • Metrics with high-cardinality labels, which multiply the number of series.
  • Traces kept at full detail for every request.
  • Data kept for longer than anyone looks at it.

Practical levers

  • Sampling: keep all errors and slow traces, and a share of the rest.
  • Filtering at the Collector: drop noisy events before they are stored.
  • Cardinality control: avoid unbounded values, such as user IDs, in metric labels.
  • Tiered retention: keep recent data hot and older data cheap.

Stay safe

  1. Decide what questions you need telemetry to answer.
  2. Measure how often each source is actually used.
  3. Cut the unused first and watch for gaps.
  4. Review costs per team, regularly.

Sources and further reading

  1. OpenTelemetry. Sampling. opentelemetry.io/docs/concepts/sampling/.

IICTP is a new independent credential and is not ISO/IEC 17024 accredited.

Keep reading

← All posts

Where do you stand?

Find the credential that fits the work you do.