SF Meetup: Inference

Harry from Inference

In this meetup talk, Harry from Inference walks through how they replaced a fragile Cloudflare queue + Postgres pipeline with ClickPipes and ClickHouse to handle LLM inference logs for a financial institution — and why the old approach kept falling over at 9am when all the engineers opened Cursor at once.

🔸 Why a Cloudflare queue backed up and caused race conditions with S3 uploads 🔸 How ClickPipes polls R2 every 5 seconds and handles the ingest without custom code 🔸 Using materialized views to pre-aggregate data so dashboards don't need to crunch raw events 🔸 A retention graph that went from 30-second load times to 2 seconds

Come join us at one of our amazing meetup groups, this presentation is from our Bay Area and Silicon Valley Meetup Group meetup on March 11th: https://www.meetup.com/clickhouse-silicon-valley-meetup-group/