Merge pull request #3274 from ClickHouse/postgres-clickpipes-public-preview

Amogh-Bharadwaj · web-flow · commit 1d947a730aa8 · 2025-02-17T23:33:34.000+05:30
Postgres ClickPipe - update preview status
diff --git a/docs/en/cloud/reference/changelog.md b/docs/en/cloud/reference/changelog.md
@@ -105,9 +105,9 @@ Org Admins can now add more email addresses to a specific notification as additi
 
 Bring Your Own Cloud for AWS is now available in Beta. This deployment model allows you to deploy and run ClickHouse Cloud in your own AWS account. We support deployments in 11+ AWS regions, with more coming soon. Please [contact support](https://clickhouse.com/support/program) for access. Note that this deployment is reserved for large-scale deployments.
 
-### Postgres Change-Data-Capture (CDC) Connector in ClickPipes (Private Preview)
+### Postgres Change-Data-Capture (CDC) Connector in ClickPipes (Public Preview)
 
-This turnkey integration enables customers to replicate their Postgres databases to ClickHouse Cloud in just a few clicks and leverage ClickHouse for blazing-fast analytics. You can use this connector for both continuous replication and one-time migrations from Postgres. Please[ sign up for Private Preview access](https://clickhouse.com/cloud/clickpipes/postgres-cdc-connector).
+This turnkey integration enables customers to replicate their Postgres databases to ClickHouse Cloud in just a few clicks and leverage ClickHouse for blazing-fast analytics. You can use this connector for both continuous replication and one-time migrations from Postgres.
 
 ### Dashboards (Beta)
 
diff --git a/docs/en/integrations/data-ingestion/clickpipes/index.md b/docs/en/integrations/data-ingestion/clickpipes/index.md
@@ -35,7 +35,7 @@ import PostgresSVG from "../../images/logos/postgresql.svg";
 | Amazon S3            |<S3SVG style={{width: '3rem', height: 'auto'}} />|Object Storage| Stable          | Configure ClickPipes to ingest large volumes of data from object storage.                            |
 | Google Cloud Storage |<GCSSVG style={{width: '3rem', height: 'auto'}} />|Object Storage| Stable          | Configure ClickPipes to ingest large volumes of data from object storage.                            |
 | Amazon Kinesis       |<AmazonKinesis style={{width: '3rem', height: 'auto'}} />|Streaming| Stable          | Configure ClickPipes and start ingesting streaming data from Amazon Kinesis into ClickHouse cloud.   |
-| Postgres             |<PostgresSVG style={{width: '3rem', height: 'auto'}} />|DBMS| Private Preview | Configure ClickPipes and start ingesting data from Postgres into ClickHouse Cloud.                   |
+| Postgres             |<PostgresSVG style={{width: '3rem', height: 'auto'}} />|DBMS| Public Preview | Configure ClickPipes and start ingesting data from Postgres into ClickHouse Cloud.                   |
 
 More connectors will get added to ClickPipes, you can find out more by [contacting us](https://clickhouse.com/company/contact?loc=clickpipes).
 
diff --git a/docs/en/integrations/data-ingestion/clickpipes/postgres/index.md b/docs/en/integrations/data-ingestion/clickpipes/postgres/index.md
@@ -11,7 +11,7 @@ import PrivatePreviewBadge from '@theme/badges/PrivatePreviewBadge';
 <PrivatePreviewBadge/>
 
 :::info
-Currently, ingesting data from Postgres to ClickHouse Cloud via ClickPipes is in Private Preview. If you are interested in trying it out, please sign up [here](https://clickpipes.peerdb.io/).
+Currently, ingesting data from Postgres to ClickHouse Cloud via ClickPipes is in Public Preview.
 :::
 
 
diff --git a/docs/en/integrations/data-ingestion/dbms/postgresql/connecting-to-postgresql.md b/docs/en/integrations/data-ingestion/dbms/postgresql/connecting-to-postgresql.md
@@ -13,13 +13,13 @@ This page covers following options for integrating PostgreSQL with ClickHouse:
 
 - using [ClickPipes](/en/integrations/clickpipes/postgres), the managed integration service for ClickHouse Cloud - now in Private Preview. Please [sign up here](https://clickpipes.peerdb.io/)
 - using `PeerDB by ClickHouse`, a CDC tool specifically designed for PostgreSQL database replication to both self-hosted ClickHouse and ClickHouse Cloud
-  - PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Private Preview. Please [sign up here](https://clickpipes.peerdb.io/)
+  - PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Public Preview.
 - using the `PostgreSQL` table engine, for reading from a PostgreSQL table
 - using the experimental `MaterializedPostgreSQL` database engine, for syncing a database in PostgreSQL with a database in ClickHouse
 
 ## Using ClickPipes (powered by PeerDB)
 
-PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Private Preview. Please [sign up here](https://clickpipes.peerdb.io/)
+PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Public Preview.
 
 ## Using the PostgreSQL Table Engine
 
diff --git a/docs/en/integrations/data-ingestion/dbms/postgresql/inserting-data.md b/docs/en/integrations/data-ingestion/dbms/postgresql/inserting-data.md
@@ -10,6 +10,6 @@ For bulk loading data from PostgreSQL, users can use:
 
 - using [ClickPipes](/en/integrations/clickpipes/postgres), the managed integration service for ClickHouse Cloud - now in Private Preview. Please [sign up here](https://clickpipes.peerdb.io/)
 - `PeerDB by ClickHouse`, an ETL tool specifically designed for PostgreSQL database replication to both self-hosted ClickHouse and ClickHouse Cloud.
-    - PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Private Preview. Please [sign up here](https://clickpipes.peerdb.io/)
+    - PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Public Preview.
 - The [Postgres Table Function](/en/sql-reference/table-functions/postgresql) to read data directly. This is typically appropriate for if batch replication based on a known watermark, e.g. a timestamp. is sufficient or if it's a once-off migration. This approach can scale to 10's of millions of rows. Users looking to migrate larger datasets should consider multiple requests, each dealing with a chunk of the data. Staging tables can be used for each chunk prior to its partitions being moved to a final table. This allows failed requests to be retried.  For further details on this bulk-loading strategy, see here.
 - Data can be exported from Postgres in CSV format. This can then be inserted into ClickHouse from either local files or via object storage using table functions.
diff --git a/docs/en/integrations/data-ingestion/dbms/postgresql/postgres-vs-clickhouse.md b/docs/en/integrations/data-ingestion/dbms/postgresql/postgres-vs-clickhouse.md
@@ -117,7 +117,7 @@ ClickHouse provides ACID properties under [limited configurations](/en/guides/de
 
 :::info
 
-PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Private Preview. Please [sign up here](https://clickpipes.peerdb.io/)
+PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Public Preview.
 
 :::
 
diff --git a/docs/en/migrations/postgres/dataset.md b/docs/en/migrations/postgres/dataset.md
@@ -13,7 +13,7 @@ As an example dataset to show a typical migration from Postgres to ClickHouse, w
 
 <br />
 
-<img src={require('../images/postgres-stackoverflow-schema.png').default}    
+<img src={require('../images/postgres-stackoverflow-schema.png').default}
   class="image"
   alt="NEEDS ALT"
   style={{width: '1000px', background: 'none'}} />
@@ -65,7 +65,7 @@ gzip -d postlinks.sql.gz
 psql < postlinks.sql
 ```
 
-While small for ClickHouse, this dataset is substantial for Postgres. The above represents a subset covering the first three months of 2024. 
+While small for ClickHouse, this dataset is substantial for Postgres. The above represents a subset covering the first three months of 2024.
 
 > While our example results use the full dataset to show performance differences between Postgres and Clickhouse, all steps documented below are functionally identical with the smaller subset. Users wanting to load the full dataset into Postgres see [here](https://pastila.nl/?00d47a08/1c5224c0b61beb480539f15ac375619d#XNj5vX3a7ZjkdiX7In8wqA==). Due to the foreign constraints imposed by the above schema, the full dataset for PostgreSQL only contains rows that satisfy referential integrity. A [Parquet version](/en/getting-started/example-datasets/stackoverflow), with no such constraints, can be easily loaded directly into ClickHouse if needed.
 
@@ -104,13 +104,13 @@ Change Data Capture (CDC) is the process by which tables are kept in sync betwee
 1. **PeerDB by ClickHouse** - PeerDB offers an open code specialist Postgres CDC solution users can run self-managed or through a SaaS solution, which has shown to perform well at scale with Postgres and ClickHouse. The solution focuses on low-level optimizations to achieve high-performance transfer data and reliability guarantees between Postgres and ClickHouse. It supports both online and offline loads.
 
   :::info
-  
-  PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Private Preview. Please [sign up here](https://clickpipes.peerdb.io/)
-  
+
+  PeerDB is now available natively in ClickHouse Cloud - Blazing-fast Postgres to ClickHouse CDC with our [new ClickPipe connector](/en/integrations/clickpipes/postgres) - now in Public Preview.
+
   :::
 
 2. **Build your own** - This can be achieved with **Debezium + Kafka** - Debezium offers the ability to capture all changes on a Postgres table, forwarding these as events to a Kafka queue. These events can then be consumed by either the ClickHouse Kafka connector or [ClickPipes in ClickHouse Cloud](https://clickhouse.com/cloud/clickpipes), for insertion into ClickHouse. This represents Change Data Capture (CDC) as Debezium will not only perform an initial copy of the tables but also ensure all subsequent updates, deletes, and inserts are detected on Postgres, resulting in the downstream events. This requires careful configuration of both Postgres, Debezium, and ClickHouse. Examples can be found [here](https://clickhouse.com/blog/clickhouse-postgresql-change-data-capture-cdc-part-2).
-	
+
 For the examples in this guide, we assume an initial bulk load only, focusing on data exploration and easy iteration toward production schemas usable for other approaches.
 
 [Click here for Part 2](/en/migrations/postgresql/designing-schemas).
