![peerdb_blog_cover.png](/uploads/peerdb_blog_cover_26a6c47078.png)

We are thrilled to announce today that ClickHouse is joining forces with PeerDB, a Change Data Capture (CDC) provider focused on Postgres, and we’re happy to welcome the PeerDB team and community into the ClickHouse family.

We believe that by combining our efforts, we’ll be able to offer a seamless and efficient integration between two leading open-source databases: Postgres and ClickHouse. This will enable bridging the gap between transactional and analytical workloads and unlock more value for users and developers. Moreover, when we met with the PeerDB team, we became even more excited because of the clear cultural fit between our companies, as well as the alignment of our engineering (performance-focused!) cultures.

<iframe width="768" height="432" src="https://www.youtube.com/embed/nzJdywZ69CA?si=MMd0xU2sCPxRI55z" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

## The two sides of the data coin

There’s a lot to be said about the Postgres and ClickHouse pair. On one hand, Postgres slowly but surely rose to its current position as 
the almost de facto transactional backend of the web. Renowned for its reliability, open-source roots, comprehensive feature set, and strong support for transactional workloads, it wasn’t surprising to see the [2024 StackOverflow survey](https://survey.stackoverflow.co/2024/technology#most-popular-technologies-database-prof) rank Postgres as the number one database for the second year in a row. 

On the other hand, in the analytics space, a similar development took place with ClickHouse over the last decade. As an open-source, high-performance, columnar database optimized for real-time analytics and handling large volumes of data with no compromise on speed and efficiency, ClickHouse’s wide adoption is a testament to the ever-growing need for real-time analytics in modern software.

![2_sides_of_a_coin.png](/uploads/2_sides_of_a_coin_943a517da9.png)

By integrating Postgres’ robust transactional capabilities with ClickHouse's analytical power via a performant and robust CDC integration, organizations can create a hybrid environment where operational data seamlessly flows into analytical processes. This allows for user-facing real-time insights and decision-making without compromising on data consistency and transactional integrity, and has been successfully adopted at scale by numerous organizations including [GitLab](https://about.gitlab.com/blog/2022/04/29/two-sizes-fit-most-postgresql-and-clickhouse/), [Instacart](https://tech.instacart.com/real-time-fraud-detection-with-yoda-and-clickhouse-bd08e9dbe3f4), [LangChain](https://clickhouse.com/blog/langchain-why-we-choose-clickhouse-to-power-langchain), [Cloudflare](https://blog.cloudflare.com/http-analytics-for-6m-requests-per-second-using-clickhouse), and [many others](https://clickhouse.com/comparison/postgresql).

## Change Data Capture, done right.

Offering a fast and reliable change data capture experience, at the scale at which ClickHouse operates, is not an easy problem to solve. When we started looking into providing a Postgres CDC connector for ClickPipes, we evaluated a list of options ranging from developing our solution, either from scratch or on top of open-source foundations, to licensing specific technologies. It was obvious from the results of the first tests we ran that PeerDB provided a unique value proposition that resonates well with ClickHouse’s core principles.

Laser-focused on Postgres as a data source, the PeerDB approach to the CDC problem doesn’t compromise on speed, with blazing-fast snapshots, while preserving reliability and correctness. Great care is also given to keeping the CDC process non-invasive to the source Postgres system which often represents a critical operational system. Other features include destination query cost control, resync capabilities, monitoring and alerting on replication slot growth, schema evolution, rich data type mapping, and the use of ClickHouse’s ReplacingMergeTree.

Javier Erro Garcia, Cloud Architecture Manager at Vueling Airlines, shared excitement about the upcoming integration: 

>“As a user of both ClickHouse Cloud and PeerDB, I am thrilled about this acquisition. We already reduced our Postgres to ClickHouse snapshot times from 10+ hours down to 15 minutes with PeerDB. Combining ClickHouse’s powerful analytics natively with PeerDB’s real-time data capture capabilities will greatly simplify our data processing workflows. This integration will enable us to build analytical applications faster, giving us a competitive edge in the market.” 
## What does it mean for the PeerDB project?

The [PeerDB](https://github.com/PeerDB-io/peerdb) project remains under ELv2 license and open to contributions. Furthermore, we are thrilled to announce that we are also releasing [PeerDB Enterprise](https://github.com/PeerDB-io/peerdb-enterprise), currently a commercial, proprietary product featuring production-grade Helm charts, under the same free and open ELv2 license. This allows any PeerDB user to easily run self-managed production-grade CDC workloads with PeerDB going forward.

## What does it mean for the PeerDB Cloud offering?

ClickHouse Cloud already comes with its very own dedicated data ingestion platform, aka ClickPipes. ClickPipes is an integration engine that simplifies data ingestion from a variety of sources, including Apache Kafka, Amazon S3, and Google Cloud Storage. As of today, ClickPipes has already been used to reliably and efficiently move more than 1 trillion rows to ClickHouse Cloud. 

By joining forces with PeerDB, we’ll add a new connector to enable the Postgres CDC use-case in ClickPipes, powered by PeerDB. This will be fully integrated into the ClickHouse Cloud experience and will benefit from the same foundations in terms of scalability, monitoring, and infrastructure.

We understand that data-engineering changes can take time to implement. For this reason, we decided to set the end-of-life (EOL) of PeerDB Cloud for existing paid customers using non-ClickHouse Cloud connectors to be one year from now, i.e. July 30th, 2025. This is to ensure that organizations that bet on PeerDB technology early on and helped make it a success have sufficient time to plan for an orderly transition. Customers will receive the same support and SLAs as promised in their contracts, and we will assist them with personalized transition plans when needed.

## I want to set up Postgres CDC to ClickHouse Cloud, do I need to wait for the Postgres CDC for ClickPipes to be available?

No, you can already sign up to the PeerDB Cloud offering as of today and connect your Postgres database to ClickHouse Cloud. We plan to continue offering this service on its existing terms for users who want to start onboarding straight away. This includes a one-month free trial.

![peerdb_demo.gif](/uploads/peerdb_demo_b642a3ae51.gif)

Once an equivalent Postgres CDC connector for ClickPipes is generally available, we’ll allow some time for the PeerDB Cloud users to stop their legacy pipelines and declare them again in ClickPipes for Postgres CDC, where they can benefit from the full eco-system of connectors and ClickHouse Cloud features.

## What’s next?

While we are very excited about bringing Postgres CDC capabilities to Clickhouse Cloud, it does not stop here and the PeerDB foundations are solid and extensible. After integrating the Postgres CDC capability we plan to expand the connector catalog of source CDC connectors to other types of databases. This will be driven primarily by demand and we would love [to get your feedback](https://clickhouse.com/company/contact) about which CDC source connector we should add next.

## Get in touch!

As always, the ClickHouse team would be honored to have the opportunity to partner with you. Whether you're using PeerDB today or are interested in efficient Postgres CDC capabilities, please [contact us!](https://clickhouse.com/company/contact)

We are thrilled to announce today that ClickHouse is joining forces with PeerDB, a Change Data Capture (CDC) provider focused on Postgres, and we’re happy to welcome the PeerDB team and community into the ClickHouse family.

large_peerdb_blog_cover.png

medium_peerdb_blog_cover.png

small_peerdb_blog_cover.png

thumbnail_peerdb_blog_cover.png

peerdb_blog_cover.png

ClickHouse welcomes PeerDB: Adding the fastest Postgres CDC to the fastest OLAP database

## We Stand with Ukraine

ClickHouse is vehemently opposed to and condemns the war of aggression in Ukraine waged by Vladimir Putin and his regime. All of us at ClickHouse are shocked and disgusted by these brutal and shameful acts of violence. We stand united with all Ukrainians whose lives have been shattered by this invasion.

Many Russians strongly oppose the actions of Putin’s regime, and have been entangled in a war not of their choice or doing. Our own employees, many of whom are of Russian origin, deplore and abhor the actions of this oppressive regime. We stand with our team and offer them our uncompromising support.

There have been a lot of incorrect statements, and misunderstanding, involving the relationship between ClickHouse, Inc. and Russia. Let’s put that to bed. ClickHouse, Inc. is a Delaware company with headquarters in the San Francisco Bay Area. We have no operations in Russia, no Russian investors, and no Russian members of our Board of Directors. We do, however, have an incredibly talented team of Russian software engineers located in Amsterdam, and we could not be more proud to call them colleagues.

The formation of our company was made possible by an agreement under which Yandex NV, a Dutch company with operations in Russia, contributed ClickHouse and the engineering team behind it, to a US-based, venture capital backed startup, with its headquarters in Silicon Valley. From the start, the plan was for the Russian engineering team to relocate to Amsterdam. When Russia invaded Ukraine on February 24, the majority of our Russian engineers had already relocated to Amsterdam, but some had not. We reacted by accelerating the relocation of our colleagues out of Russia as fast as we could, and feel so fortunate that as of the date of this blog post, that process has been completed.

However, until that process was complete, we made the decision to largely refrain from broadcasting our views on Putin’s invasion of Ukraine as we wanted to ensure our people and their families were safely out of Russia before making the sort of strong public condemnation Putin’s actions require.


## Statement from Aaron Katz, our CEO: 

Let me start by personally condemning Russia’s senseless and unprovoked invasion of Ukraine. It violates international law and has caused incalculable human suffering.

When I was approached with the idea of spinning ClickHouse out of Yandex, the first thought that went through my mind was: _how can I unleash the potential of ClickHouse while distancing the company from Russia?_ While I believed strongly in the power and potential of the technology, the idea of me and a dozen unknown engineers in Moscow coming together to create a company seemed quite obscure. As I spent more time with Alexey Milovidov, the creator of ClickHouse, the idea of creating ClickHouse, Inc., an independent company, started to take shape. When Yury Izrailevsky decided to join us and run product and engineering, any uncertainty I held quickly dissipated as I have long considered Yury one of the most talented engineering leaders in our industry.

Building a distributed and diverse team has always been our vision since the company’s inception. Today, we have over 70 employees living around the world in the United States, the Netherlands, Germany, France, Spain, United Kingdom, Australia, and Israel.

Questions have circulated about the governance and control of our company. Hopefully our comments above address any remaining questions folks may have.

We hope that this information is helpful to our community and clarifies our position, and we join the rest of the world in hoping for a peaceful resolution to this unprovoked invasion, one which acknowledges the incredible injustices that have been faced by the Ukrainian people. We admire their courage, their resilience, and their fortitude in the face of such a senseless and cowardly act, and have contributed to [UNICEF](https://www.unicef.org/), the [UN Refugee Agency](https://www.unhcr.org/), and [Voices of the Children](https://www.voicesofthechildren.org/) to assist with humanitarian efforts on the ground.

I am excited about our future, the future of our community, customers, and partners. I am grateful for the opportunity to work on bringing this breakthrough technology openly and freely to the world alongside our incredible and resilient team.


## Statement from Yury Izrailevsky, our President and Head of Product and Engineering

This brutal invasion, and the humanitarian disaster that it is causing in Ukraine, defies belief. I come from an Ukrainian Jewish family, and these events are deeply troubling to me at a very personal level. Seeing video footage of bombed out buildings in Kyiv, right where I used to visit my grandparents while growing up, is a surreal experience. I hope for an immediate stop to this war and return to peace and security for the Ukrainian people.

I moved to the US as a high school student three decades ago and I am a proud US citizen. I was educated in the US and I’ve spent my entire professional career in Silicon Valley, working for companies like Google, Netflix and Yahoo. When the opportunity came up to co-found ClickHouse, together with my old friend Aaron Katz and a new-found friend and brilliant engineer Alexey Milovidov, I jumped on it immediately. Turning ClickHouse, the fastest analytics database, into what we believe will become the best cloud-native serverless analytics platform, has been the most exciting experience of my career.

We founded ClickHouse in the United States, using our collective Silicon Valley experience. ClickHouse is fundamentally a global company, where we bring together the best talent from all over the world. We are excited to work with Alexey and several other amazing Russian, Ukrainian and Belarusian engineers, who are now safe and working in our Amsterdam office, alongside many more engineers based in the US, Germany, Israel, France, UK and other countries.


## Statement from Alexey Milovidov, our CTO

My team and I created ClickHouse and made it open-source five years ago to be a global technology, used across the world without borders. We have spent years building a diverse distributed community and I am proud that ClickHouse helps businesses and people in Europe and Asia, North and South America, Africa and Australia, Russia and Ukraine…

The news of February 24th came as a deep shock to me. I strongly condemn Putin’s war in Ukraine and dream that it ends as soon as possible with the defeat of the aggressor and peace and prosperity in Ukraine.

We have no infrastructure, servers or people in Russia. The original engineering team successfully moved out of Russia and are now working in our Amsterdam office.

When you create an open-source project, you are building a technology without borders — software that is for everyone, and a community that exists everywhere. Implicitly, acts of war, invasion, and violence stand in opposition to that vision. We join the rest of the world in hoping for a swift and just end to this conflict.

Aaron Katz

Blog posts by Aaron Katz

ClickHouse welcomes PeerDB: Adding the fastest Postgres CDC to the fastest OLAP database

We Stand With Ukraine