Shopify’s Open Source Approach to Network Monitoring with eBPF, Vector and ClickHouse

Sebastian Rabenhorst & Matt Franklin, Shopify

At Shopify, they successfully implemented a scalable, open-source network monitoring solution for the cloud. In this talk, they will demonstrate how they built a network monitoring solution leveraging eBPF, Vector, ClickHouse, and Grafana. This solution enables them to monitor over 30 million network flow, DNS and other networking-related events per second at the container level for thousands of services across hundreds of Kubernetes clusters in the Shopify Cloud.