The One Trillion Row Challenge - we query 1 trillion rows for < $0.5

One billion row challenge was a walk in the park, with a ClickHouse Local setup solving the problem in around 19 seconds using the exact hardware stipulated by the rules. The One Trillion Row Challenge, though, is a totally different story. In this talk, Dale dove into our response to the challenge, using spot instances in AWS, and a Pulumi script to spin up a ClickHouse cluster, completing the query in under 3 minutes for less than a dollar!

This presentation was given at the ClickHouse Bangalore Meetup on May 4.

The audio quality is not optimal due to the meetup venue in-house microphone system.