Writing to Apache Iceberg from ClickHouse

Mark Needham

This video explores ClickHouse's experimental support for Apache Iceberg writes, introduced in version 25.7. We'll walk you through the process of creating, querying, and writing to Iceberg tables using both PySpark and ClickHouse. This practical demonstration showcases the seamless integration between these powerful data technologies.

Key points covered:

• Setting up an Iceberg table with PySpark and importing New York taxi data
• Querying Iceberg tables in ClickHouse using the iceberg_local engine
• Performing inserts from ClickHouse into Iceberg tables
• Exploring Iceberg's snapshot history and time travel queries
• Demonstrating the interoperability between PySpark and ClickHouse when working with Iceberg