- Resources
- Engineering
ClickHouse engineering resources
How to convert CSV to Arrow
Convert a CSV file to the Arrow IPC format in one command with clickhouse-local — the schema is inferred from the CSV and the column types are embedded in the Arrow file, with no server and no upload.
Last updated: Jun 15, 2026
How to convert Avro to Parquet
Convert an Avro file to Parquet with one clickhouse-local command. The schema embedded in the Avro file is read automatically and carried into Parquet, with no server and no upload.
Last updated: Jun 15, 2026
How to convert Arrow to CSV
Convert an Arrow (Arrow IPC / Feather) file to CSV with one clickhouse-local command. The schema is read from the file, types carry over, and there's no upload and no server.
Last updated: Jun 15, 2026
What is MessagePack?
MessagePack is a compact binary serialization format that encodes the same data model as JSON in far fewer bytes. This page explains how it is laid out and proves it by reading a real .msgpack file.
Last updated: Jun 15, 2026
What is an .npy file?
An .npy file is NumPy's simple binary format for storing a single numeric array: a small text header describing dtype and shape, followed by the raw bytes. This page explains its structure and proves it by reading one with clickhouse local.
Last updated: Jun 15, 2026
How to read an NPY file in Python
Read a NumPy .npy array into a DataFrame with chDB and work with it using the pandas API you already know, without loading the whole array into memory.
Last updated: Jun 15, 2026
How to read a .npy (NumPy) file with SQL
Query a NumPy .npy array file with SQL from your terminal using clickhouse local. The dtype is read from the file, with no Python and no import step.
Last updated: Jun 15, 2026
How to read a MessagePack file in Python
Read a MessagePack (.msgpack) file into a DataFrame with chDB. MsgPack carries no schema, so you pass the column list once and then use the pandas API you already know, running on ClickHouse's engine.
Last updated: Jun 15, 2026
How to read a MessagePack file
Read a MessagePack (.msgpack) file with SQL from your terminal using clickhouse local. MsgPack carries no schema, so you pass the column structure explicitly in one command.
Last updated: Jun 15, 2026
How to convert NPY to Parquet
Convert a NumPy .npy file to Parquet from your terminal with clickhouse-local — the array dtype is read straight from the .npy header and carried into typed Parquet, with no upload and no Python.
Last updated: Jun 15, 2026
How to convert NPY to CSV
Convert a NumPy .npy array to CSV from your terminal with clickhouse-local — the dtype is read from the .npy header, with no upload and no Python.
Last updated: Jun 15, 2026
How to convert MessagePack to JSON
Convert a MessagePack (.msgpack) file to JSON from your terminal with clickhouse-local — one command, no server and no upload, with the column types carried through into the output.
Last updated: Jun 15, 2026
How to convert MessagePack to CSV
Convert a MessagePack (.msgpack) file to CSV from your terminal with clickhouse-local — one command, no server, no upload, and types carried straight into the CSV.
Last updated: Jun 15, 2026
What is a BSON file?
A BSON file is MongoDB's binary, typed, length-prefixed encoding of JSON documents. This page explains its structure and proves it by reading a real .bson file with clickhouse local.
Last updated: Jun 15, 2026
How to read a Feather file in Python (faster than pandas)
Read a Feather file into a DataFrame with chDB, a drop-in replacement for pandas. Change one import line and your existing pandas code runs on ClickHouse's engine, so it stays fast as files grow.
Last updated: Jun 15, 2026