How Snowflake prepares incoming data
Pause
FOR CONTEXT
How real-time systems keep incoming data query-ready
Fresh-data path
Query-ready data
Newly
written
Ordered
raw data
Ordered pre-
aggregated
Query engine
Query
compute
Fresh
data
continuously
Fast
answers
continuously
1
Store in
columns
2
Order
data
3
Order and pre-
aggregate data
Snowflake
Fresh-data path
Query-ready data
1
2
Snowpipe
Streaming
High-performance
architecture
Interactive table
Ordered
raw data
Interactive MV
Ordered pre-
aggregated
NBBO
quotes
1M rows/s
3
Async
serverless
MV refresh
Fallback
warehouse
Gen 2 · Small · 16 CPUs
Interactive
warehouse
Small · 16 CPUs
600 GB cache
Query
results