Piping Server Side Events (SSE) into ClickHouse

Mark Needham

Learn how to pipe server-side events straight into ClickHouse using the Wikimedia recent changes feed as a real-world example. This tutorial covers the complete process from connecting to the event stream to troubleshooting why your data might not appear immediately in the database.

• Set up ClickHouse table with JSON column for streaming data
• Configure critical ingestion parameters like max_insert_block_size and min_insert_block_size
• Monitor real-time data ingestion and understand how ClickHouse organizes streaming data into parts
• Troubleshoot common streaming data pitfalls

The techniques shown work with any streaming data source, not just server-side events.