ClickHouse at AWS re:Invent 2024 - Product Announcement Roundup

We are excited to join AWS re:Invent this year!

In addition to throwing an incredible [Click]House Party, we are making a score of product announcements:

• Bring-Your-Own-Cloud deployment for AWS (Beta)
• Postgres CDC connector in ClickPipes (Private Preview)
• AWS PrivateLink and VPC Lattice (Launch Partner)
• Dashboards (Beta)
• Query API Endpoints (GA)
• Native JSON support (Beta)
• Vector search using vector similarity indexes (Early Access)

Please read the summary below and come by our booth #1737 to find out more!

We are excited to announce the Beta launch of Bring-Your-Own-Cloud (BYOC) for AWS!

This new deployment model allows you to deploy and run ClickHouse Cloud in your own AWS account, giving you the best of both worlds: the performance, scalability, and simplicity of ClickHouse Cloud with the control and security of running in your own environment. No need to worry about managing setup, scaling, or upgrades—we handle it all for you.

This deployment is designed for customers with stringent data residency and security requirements, such as financial services, cybersecurity, healthcare, and other industries that manage PII or other sensitive information and need to comply with advanced data protection requirements. We support deployments in 11+ AWS regions with more coming soon!

👉 Join the BYOC waitlist

We are excited to announce the private preview of the Postgres Change Data Capture (CDC) connector in ClickPipes!

This turnkey integration enables customers to replicate their Postgres databases to ClickHouse Cloud in just a few clicks and leverage ClickHouse for blazing-fast analytics. You can use this connector for both continuous replication and one-time migrations from Postgres. This integration eliminates the need for external ETL tools, which are often expensive, slow, and do not scale for Postgres. With features like parallel snapshotting, you can achieve 10x faster initial loads and replication latency as low as a few seconds for continuous replication (CDC).

The Postgres CDC connector for ClickPipes supports any Postgres database, whether running in the cloud or on-premise, as a data source—including AWS RDS for PostgreSQL. In fact, RDS Postgres is the most commonly used data source among our customers. This includes customers such as SpotOn, Vueling, Daisychain and others already integrating their RDS Postgres databases with ClickHouse Cloud using this connector.

This launch marks a major milestone following the PeerDB acquisition, made just a few months ago, for a native integration of Postgres with ClickHouse. It builds on a common trend across customers like GitLab, LangChain, Cloudflare and Instacart that rely on Postgres and ClickHouse to address most of their data challenges. Postgres powers their mission-critical transactional and web applications, while ClickHouse powers analytics. Both are purpose-built databases designed for distinct workloads and share the same Open Source ethos. With the release of the Postgres CDC connector, we are making the Postgres + ClickHouse integration even easier for customers.

👉 Sign up for the private preview

We are proud to announce that we are an AWS Launch Partner for Cross-VPC resource access with PrivateLink and VPC Lattice!

With ClickPipes, you can now grant uni-directional access to a specific data source like AWS MSK. With Cross-VPC resource access with AWS PrivateLink and VPC Lattice, you can share individual resources across VPC and account boundaries, or even from on-premise networks without compromising on privacy and security when going over a public network.

👉 To get started and set up a resource share, you can read the announcement blog post that walks you through how to configure Cross-VPC resource access through PrivateLink and VPC Lattice.

We are excited to announce the Beta launch of Dashboards in ClickHouse Cloud!

With this new capability, you can use the most powerful real-time database to visualize and share your data across your organization. ClickHouse Cloud’s SQL console allows users to query data using saved queries. With Dashboards, users can turn saved queries into visualizations, organize visualizations onto dashboards, and interact with dashboards using query parameters.

We hope that ClickHouse Cloud native Dashboards will help you to expand access to your real-time data.

👉 To get started follow the dashboards documentation

We are excited to announce the GA release of Query API Endpoints in ClickHouse Cloud!

Already used in production by customers with thousands of active endpoints serving millions of requests daily, Query API Endpoints allow you to spin up RESTful API endpoints for saved queries in just a couple of clicks and begin consuming data in your application without wrangling language clients or authentication complexity. Our blog post announcing the beta launch describes the core functionality in greater detail, but since the initial launch, we have shipped a number of improvements including:

• Reducing endpoint latency, especially for cold-starts
• Increased endpoint RBAC controls
• Configurable CORS-allowed domains
• Result streaming
• Support for all ClickHouse-compatible output formats

In addition to these improvements, we are excited to announce generic query API endpoints that, leveraging our existing framework, allow you to execute arbitrary SQL queries against your ClickHouse Cloud service(s). Generic endpoints can be enabled and configured from the service settings page.

…and that’s not all! In the near term, we are planning to add support for programmatic creation and management of endpoints (via Cloud API and Terraform), version control, cache configuration, and more latency reductions. As always, please reach out to us with any feedback or feature requests!

👉 To get started follow the Query API Endpoints documentation

We are launching the Beta of native JSON support in ClickHouse Cloud!

The native JSON support feature received a dizzying amount of interest from our community recently—and for good reason! It’s a powerful addition that makes it much easier to migrate from systems like Elasticsearch or Rockset, and also to load JSON data directly to ClickHouse.

Building this feature was no small task. It relied on multiple foundational components, such as the dynamic and variant data types, to handle its complexity, you can read more about it in our recent blog post, How we built a new powerful JSON data type for ClickHouse. For this reason, we initially released it as experimental and conducted a private preview with selected customers. The feedback we received has been very positive. It helped us enrich the feature roadmap and gave us a lot of confidence in moving it to beta so more users can start taking advantage of it.

👉 To get started, please contact support to enable on your cloud service.

Last, but certainly not least – we are announcing vector similarity indexes for approximate vector search in early access!

ClickHouse already offers robust support for vector-based use cases, with a wide range of distance functions and the ability to perform linear scans. In addition, more recently we added an experimental approximate vector search approach powered by the usearch library and the Hierarchical Navigable Small Worlds (HNSW) approximate nearest neighbor search algorithm. Today, we are excited to announce that this feature is soon entering Beta in ClickHouse Cloud, and we are opening early access registration for users to test it on their own data.

👉 To get started, please sign up for the early access waitlist.

We hope you enjoyed these announcements. If you are not yet a ClickHouse Cloud user on AWS, please sign up via AWS Marketplace or directly at ClickHouse Cloud. Either way, you’ll enjoy a $300 credit toward your free trial, and even more benefits if you are part of the AWS Startup program.