Where the money goes
- High-volume, low-value logs.
- Metrics with high-cardinality labels, which multiply the number of series.
- Traces kept at full detail for every request.
- Data kept for longer than anyone looks at it.
Practical levers
- Sampling: keep all errors and slow traces, and a share of the rest.
- Filtering at the Collector: drop noisy events before they are stored.
- Cardinality control: avoid unbounded values, such as user IDs, in metric labels.
- Tiered retention: keep recent data hot and older data cheap.
Stay safe
- Decide what questions you need telemetry to answer.
- Measure how often each source is actually used.
- Cut the unused first and watch for gaps.
- Review costs per team, regularly.
Sources and further reading
- OpenTelemetry. Sampling. opentelemetry.io/docs/concepts/sampling/.
IICTP is a new independent credential and is not ISO/IEC 17024 accredited.