Read how we scaled our observability platform from 19PB to 100PB and 500 trillion rows by replacing OpenTelemetry with a native ClickHouse-to-ClickHouse pipeline, embracing wide events and cutting CPU usage by 90%.

large_Blog_LoghouseP2_2025_Final.png

medium_Blog_LoghouseP2_2025_Final.png

small_Blog_LoghouseP2_2025_Final.png

thumbnail_Blog_LoghouseP2_2025_Final.png

Blog_LoghouseP2_2025_Final.png

Scaling our Observability platform beyond 100 Petabytes by embracing wide events and replacing OTel

In this blog post, we share our journey to build a ClickHouse-powered logging solution that today stores over 19 PiB of data (1.13 PiB compressed) in our AWS regions alone, and costs 200x less than Datadog.

large_logging_thumbnail.png

medium_logging_thumbnail.png

small_logging_thumbnail.png

thumbnail_logging_thumbnail.png

logging_thumbnail.png

How we Built a 19 PiB Logging Platform with ClickHouse and Saved Millions

Linux, macOS, FreeBSD

Rory Crispin

Blog posts by Rory Crispin

Scaling our Observability platform beyond 100 Petabytes by embracing wide events and replacing OTel

How we Built a 19 PiB Logging Platform with ClickHouse and Saved Millions