Skip to content

The Journey to Zero-Copy: How chDB Became the Fastest SQL Engine on Pandas DataFrame

YouTube Video: e9x_r-hlvZ0

Auxten Wang

Technical Director at ClickHouse

In this talk, Auxten Wang, creator and lead developer of chDB, shared the story of how the world’s fastest OLAP engine was made to fly on Pandas DataFrames, reducing query times from 30 seconds to just 0.5 seconds. He walked through chDB’s evolution from a serialization-bound prototype into a fully zero-copy SQL engine for Pandas, covering how DataFrame and Parquet round-trips were eliminated, how Python GIL limitations were overcome, and how string handling was re-thought for parallel performance. The result is true DataFrame in and DataFrame out SQL with ClickHouse speed, delivering up to 200× faster analytics, native JSON support, streaming for data larger than RAM, and a complete zero copy loop with no servers, no setup, and no friction.

Related videos

YouTube Video: XVu4pb_6mHw

Meetups

HPE EdgeConnect: From MySQL to ClickHouse Cloud

Vignesh Senapathy, Sr.Principal Devops Engineer, explain why HPE moved its telemetry from MySQL to ClickHouse Cloud

YouTube Video: 95TslI4AqwY

User stories, Meetups

How Equativ powers real-time advertising products with ClickHouse Cloud

Adrien Coulaud and Jean-Denis Costa explain how Equativ uses ClickHouse Cloud for customer-facing reporting, fast lookups, and operational feedback across its advertising products.

YouTube Video: mc3K4unjRKQ

Meetups

ClickHouse Bangkok Meetup - NEOZO Cloud

Presented by, Maximilian (Max) Simmoteit, Solutions Architect - Data @ NEOZO Cloud, at our Bangkok Meetup.

Follow us

XBlueskySlackGithubTelegramMeetupRSS