The Journey to Zero-Copy: How chDB Became the Fastest SQL Engine on Pandas DataFrame

Auxten Wang
Technical Director at ClickHouse
In this talk, Auxten Wang, creator and lead developer of chDB, shared the story of how the world’s fastest OLAP engine was made to fly on Pandas DataFrames, reducing query times from 30 seconds to just 0.5 seconds. He walked through chDB’s evolution from a serialization-bound prototype into a fully zero-copy SQL engine for Pandas, covering how DataFrame and Parquet round-trips were eliminated, how Python GIL limitations were overcome, and how string handling was re-thought for parallel performance. The result is true DataFrame in and DataFrame out SQL with ClickHouse speed, delivering up to 200× faster analytics, native JSON support, streaming for data larger than RAM, and a complete zero copy loop with no servers, no setup, and no friction.
Related videos
View all Videos
Meetups
HPE EdgeConnect: From MySQL to ClickHouse Cloud
Vignesh Senapathy, Sr.Principal Devops Engineer, explain why HPE moved its telemetry from MySQL to ClickHouse Cloud

User stories, Meetups
How Equativ powers real-time advertising products with ClickHouse Cloud
Adrien Coulaud and Jean-Denis Costa explain how Equativ uses ClickHouse Cloud for customer-facing reporting, fast lookups, and operational feedback across its advertising products.

Meetups
ClickHouse Bangkok Meetup - NEOZO Cloud
Presented by, Maximilian (Max) Simmoteit, Solutions Architect - Data @ NEOZO Cloud, at our Bangkok Meetup.

Meetups
ClickHouse Bangkok Meetup - ClickHouse for Feature Engineering in FinTech
Presented by, Alua Magavyanova, Fraud Data Scientist & Risk Data Analyst @ Yusr Fintech, Dubai, at our Bangkok Meetup.