Nishad Krishnan Senior Software engineer @ Temporal
INishad Krishnan Senior Software engineer @ Temporal shares a real-world story: a financial institution needed visibility into how their engineers were using a custom LLM, and their first solution — Cloudflare queues + Postgres — couldn't keep up. Here's what they rebuilt it with using ClickHouse.
🔸 The original architecture: Cloudflare Worker → R2 → Queue → Postgres, and where it broke 🔸 ClickPipes as the ingest layer: polling R2 with a 5-second interval, no custom ingester needed 🔸 Materialized views for hour/day/week aggregations — no per-request storage required 🔸 Querying retention data and per-user conversation history with sub-2-second response times
Come join us at one of our amazing meetup groups, this presentation is from our Seattle meetup: https://www.meetup.com/clickhouse-seattle-user-group/
