ClickHouse for network and applications analytics data for Cyber Security

The modern IP network and applications hosted by the modern enterprises create large amounts of the network data. The IP packets-based data is the ultimate truth that we believe in. The size of the enterprise/s and the kind of the network data we want to collect makes very large amounts of data that needs to be ingested in the database! On top of that the analytics engines run that consume this data and again create more data!

To handle this data, the database must not only be able to ingest it but also should be able to cater to the queries that consume this data. And that too fast! The modern applications can’t wait for the data to arrive after 11 seconds! This is where we thought of bringing in ClickHouse into the equation. We will elaborate on our journey from evaluation to design and to productization of ClickHouse as the database in our product.

This talk was delivered live at the ClickHouse Pune meetup on September 20, at One2N's office by Ajit Bhat, Engineering Manager, & Afzal Khan, Principal Software Engineer at Netscout.

The full agenda can be found at https://www.meetup.com/clickhouse-pune-user-group/events/310644227/