Skip to main content

One post tagged with "Engineering"

Engineering posts

View All Tags

From OTel to Rotel: Petabyte-scale tracing with 4x greater throughput

Mike Heffner
Mike Heffner
Ray Jenkins
Ray Jenkins

TLDR;​

  • Efficiency at scale matters: Small reductions in resource usage can have massive implications on cost and efficiency
  • Benchmarking OTel + ClickHouse: We construct a pipeline to benchmark streaming trace data into ClickHouse
  • Rotel scales 4x: We explore how we scaled from 137K trace spans/sec per-core with the OTel Collector to 462K trace spans/sec per-core with Rotel, detailing several key performance improvements
  • Tools and resources: Find the tools we used to drive our benchmark evaluation