diff --git a/docs/content.zh/docs/connectors/flink-sources/overview.md b/docs/content.zh/docs/connectors/flink-sources/overview.md index bdc1a23286a..4867933a359 100644 --- a/docs/content.zh/docs/connectors/flink-sources/overview.md +++ b/docs/content.zh/docs/connectors/flink-sources/overview.md @@ -50,22 +50,24 @@ You can also read [tutorials]({{< ref "docs/connectors/flink-sources/tutorials/b ## Supported Flink Versions The following table shows the version mapping between Flink® CDC Connectors and Flink®: -| Flink® CDC Version | Flink® Version | -|:-----------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| -| 1.0.0 | 1.11.* | -| 1.1.0 | 1.11.* | -| 1.2.0 | 1.12.* | -| 1.3.0 | 1.12.* | -| 1.4.0 | 1.13.* | -| 2.0.* | 1.13.* | -| 2.1.* | 1.13.* | -| 2.2.* | 1.13.\*, 1.14.\* | -| 2.3.* | 1.13.\*, 1.14.\*, 1.15.\*, 1.16.\* | -| 2.4.* | 1.13.\*, 1.14.\*, 1.15.\*, 1.16.\*, 1.17.\* | -| 3.0.* | 1.14.\*, 1.15.\*, 1.16.\*, 1.17.\*, 1.18.\* | -| 3.1.* | 1.16.\*, 1.17.\*, 1.18.\*, 1.19.\* | -| 3.2.* | 1.17.\*, 1.18.\*, 1.19.\*, 1.20.\* | -| 3.3.* | 1.19.\*, 1.20.\* | +| Flink® CDC Version | Flink® Version | +|:-----------------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| +| 1.0.0 | 1.11.* | +| 1.1.0 | 1.11.* | +| 1.2.0 | 1.12.* | +| 1.3.0 | 1.12.* | +| 1.4.0 | 1.13.* | +| 2.0.* | 1.13.* | +| 2.1.* | 1.13.* | +| 2.2.* | 1.13.\*, 1.14.\* | +| 2.3.* | 1.13.\*, 1.14.\*, 1.15.\*, 1.16.\* | +| 2.4.* | 1.13.\*, 1.14.\*, 1.15.\*, 1.16.\*, 1.17.\* | +| 3.0.* | 1.14.\*, 1.15.\*, 1.16.\*, 1.17.\*, 1.18.\* | +| 3.1.* | 1.16.\*, 1.17.\*, 1.18.\*, 1.19.\* | +| 3.2.* | 1.17.\*, 1.18.\*, 1.19.\*, 1.20.\* | +| 3.3.* | 1.19.\*, 1.20.\* | +| 3.4.* | 1.19.\*, 1.20.\* | +| 3.5.* | 1.19.\*, 1.20.\* | ## Features diff --git a/docs/content.zh/docs/connectors/pipeline-connectors/fluss.md b/docs/content.zh/docs/connectors/pipeline-connectors/fluss.md index 70086632d62..bca232b9843 100644 --- a/docs/content.zh/docs/connectors/pipeline-connectors/fluss.md +++ b/docs/content.zh/docs/connectors/pipeline-connectors/fluss.md @@ -223,7 +223,7 @@ Data Type Mapping VARCHAR(n) - VARCHAR(n) + STRING diff --git a/docs/content.zh/docs/connectors/pipeline-connectors/overview.md b/docs/content.zh/docs/connectors/pipeline-connectors/overview.md index f06b5040e45..6fe3f97b9d4 100644 --- a/docs/content.zh/docs/connectors/pipeline-connectors/overview.md +++ b/docs/content.zh/docs/connectors/pipeline-connectors/overview.md @@ -32,14 +32,17 @@ Flink CDC 提供了可用于 YAML 作业的 Pipeline Source 和 Sink 连接器 | 连接器 | 类型 | 支持的外部系统 | 下载链接 | |----------------------------------------------------------------------------------|--------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}}) | Sink |
  • [Apache Doris](https://doris.apache.org/): 1.2.x, 2.x.x, 3.x.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.3.0/flink-cdc-pipeline-connector-doris-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.1/flink-cdc-pipeline-connector-doris-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.0/flink-cdc-pipeline-connector-doris-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.1/flink-cdc-pipeline-connector-doris-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.0/flink-cdc-pipeline-connector-doris-3.1.0.jar) | -| [Elasticsearch]({{< ref "docs/connectors/pipeline-connectors/elasticsearch" >}}) | Sink |
  • [Elasticsearch](https://www.elastic.co/elasticsearch): 6.x, 7.x, 8.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.3.0/flink-cdc-pipeline-connector-elasticsearch-3.3.0.jar) | -| [Kafka]({{< ref "docs/connectors/pipeline-connectors/kafka" >}}) | Sink |
  • [Kafka](https://kafka.apache.org/) | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.3.0/flink-cdc-pipeline-connector-kafka-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.1/flink-cdc-pipeline-connector-kafka-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.0/flink-cdc-pipeline-connector-kafka-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.1/flink-cdc-pipeline-connector-kafka-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.0/flink-cdc-pipeline-connector-kafka-3.1.0.jar) | -| [MySQL]({{< ref "docs/connectors/pipeline-connectors/mysql" >}}) | Source |
  • [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x
  • [RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x
  • [PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x
  • [Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x
  • [MariaDB](https://mariadb.org): 10.x
  • [PolarDB X](https://github.com/ApsaraDB/galaxysql): 2.0.1 | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.3.0/flink-cdc-pipeline-connector-mysql-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.1/flink-cdc-pipeline-connector-mysql-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.0/flink-cdc-pipeline-connector-mysql-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.1/flink-cdc-pipeline-connector-mysql-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.0/flink-cdc-pipeline-connector-mysql-3.1.0.jar) | -| [OceanBase]({{< ref "docs/connectors/pipeline-connectors/oceanbase" >}}) | Sink |
  • [OceanBase](https://www.oceanbase.com/): 3.x, 4.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.3.0/flink-cdc-pipeline-connector-oceanbase-3.3.0.jar) | -| [Paimon]({{< ref "docs/connectors/pipeline-connectors/paimon" >}}) | Sink |
  • [Paimon](https://paimon.apache.org/): 0.6, 0.7, 0.8, 0.9, 1.0 | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.3.0/flink-cdc-pipeline-connector-paimon-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.1/flink-cdc-pipeline-connector-paimon-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.0/flink-cdc-pipeline-connector-paimon-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.1/flink-cdc-pipeline-connector-paimon-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.0/flink-cdc-pipeline-connector-paimon-3.1.0.jar) | -| [StarRocks]({{< ref "docs/connectors/pipeline-connectors/starrocks" >}}) | Sink |
  • [StarRocks](https://www.starrocks.io/): 2.x, 3.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.3.0/flink-cdc-pipeline-connector-starrocks-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.1/flink-cdc-pipeline-connector-starrocks-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.0/flink-cdc-pipeline-connector-starrocks-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.1/flink-cdc-pipeline-connector-starrocks-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.0/flink-cdc-pipeline-connector-starrocks-3.1.0.jar) | -| [MaxCompute]({{< ref "docs/connectors/pipeline-connectors/maxcompute" >}}) | Sink |
  • [MaxCompute](https://www.aliyun.com/product/maxcompute) | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.3.0/flink-cdc-pipeline-connector-maxcompute-3.3.0.jar) | | +| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}}) | Sink |
  • [Apache Doris](https://doris.apache.org/): 1.2.x, 2.x.x, 3.x.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.5.0/flink-cdc-pipeline-connector-doris-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.4.0/flink-cdc-pipeline-connector-doris-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.3.0/flink-cdc-pipeline-connector-doris-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.1/flink-cdc-pipeline-connector-doris-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.0/flink-cdc-pipeline-connector-doris-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.1/flink-cdc-pipeline-connector-doris-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.0/flink-cdc-pipeline-connector-doris-3.1.0.jar) | +| [Elasticsearch]({{< ref "docs/connectors/pipeline-connectors/elasticsearch" >}}) | Sink |
  • [Elasticsearch](https://www.elastic.co/elasticsearch): 6.x, 7.x, 8.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.5.0/flink-cdc-pipeline-connector-elasticsearch-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.4.0/flink-cdc-pipeline-connector-elasticsearch-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.3.0/flink-cdc-pipeline-connector-elasticsearch-3.3.0.jar) | +| [Iceberg]({{< ref "docs/connectors/pipeline-connectors/iceberg" >}}) | Sink |
  • [Apache Iceberg](https://iceberg.apache.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-iceberg/3.5.0/flink-cdc-pipeline-connector-iceberg-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-iceberg/3.4.0/flink-cdc-pipeline-connector-iceberg-3.4.0.jar) | +| [Fluss]({{< ref "docs/connectors/pipeline-connectors/fluss" >}}) | Sink |
  • [Fluss](https://fluss.apache.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-fluss/3.5.0/flink-cdc-pipeline-connector-fluss-3.5.0.jar) | +| [Kafka]({{< ref "docs/connectors/pipeline-connectors/kafka" >}}) | Sink |
  • [Kafka](https://kafka.apache.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.5.0/flink-cdc-pipeline-connector-kafka-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.4.0/flink-cdc-pipeline-connector-kafka-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.3.0/flink-cdc-pipeline-connector-kafka-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.1/flink-cdc-pipeline-connector-kafka-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.0/flink-cdc-pipeline-connector-kafka-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.1/flink-cdc-pipeline-connector-kafka-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.0/flink-cdc-pipeline-connector-kafka-3.1.0.jar) | +| [MySQL]({{< ref "docs/connectors/pipeline-connectors/mysql" >}}) | Source |
  • [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x
  • [RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x
  • [PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x
  • [Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x
  • [MariaDB](https://mariadb.org): 10.x
  • [PolarDB X](https://github.com/ApsaraDB/galaxysql): 2.0.1 | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.5.0/flink-cdc-pipeline-connector-mysql-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.4.0/flink-cdc-pipeline-connector-mysql-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.3.0/flink-cdc-pipeline-connector-mysql-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.1/flink-cdc-pipeline-connector-mysql-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.0/flink-cdc-pipeline-connector-mysql-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.1/flink-cdc-pipeline-connector-mysql-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.0/flink-cdc-pipeline-connector-mysql-3.1.0.jar) | +| [Postgres]({{< ref "docs/connectors/pipeline-connectors/postgres" >}}) | Source |
  • [PostgreSQL](https://www.postgresql.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-postgres/3.5.0/flink-cdc-pipeline-connector-postgres-3.5.0.jar) | +| [OceanBase]({{< ref "docs/connectors/pipeline-connectors/oceanbase" >}}) | Sink |
  • [OceanBase](https://www.oceanbase.com/): 3.x, 4.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.5.0/flink-cdc-pipeline-connector-oceanbase-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.4.0/flink-cdc-pipeline-connector-oceanbase-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.3.0/flink-cdc-pipeline-connector-oceanbase-3.3.0.jar) | +| [Paimon]({{< ref "docs/connectors/pipeline-connectors/paimon" >}}) | Sink |
  • [Paimon](https://paimon.apache.org/): 0.6, 0.7, 0.8, 0.9, 1.0 | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.5.0/flink-cdc-pipeline-connector-paimon-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.4.0/flink-cdc-pipeline-connector-paimon-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.3.0/flink-cdc-pipeline-connector-paimon-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.1/flink-cdc-pipeline-connector-paimon-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.0/flink-cdc-pipeline-connector-paimon-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.1/flink-cdc-pipeline-connector-paimon-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.0/flink-cdc-pipeline-connector-paimon-3.1.0.jar) | +| [StarRocks]({{< ref "docs/connectors/pipeline-connectors/starrocks" >}}) | Sink |
  • [StarRocks](https://www.starrocks.io/): 2.x, 3.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.5.0/flink-cdc-pipeline-connector-starrocks-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.4.0/flink-cdc-pipeline-connector-starrocks-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.3.0/flink-cdc-pipeline-connector-starrocks-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.1/flink-cdc-pipeline-connector-starrocks-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.0/flink-cdc-pipeline-connector-starrocks-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.1/flink-cdc-pipeline-connector-starrocks-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.0/flink-cdc-pipeline-connector-starrocks-3.1.0.jar) | +| [MaxCompute]({{< ref "docs/connectors/pipeline-connectors/maxcompute" >}}) | Sink |
  • [MaxCompute](https://www.aliyun.com/product/maxcompute) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.5.0/flink-cdc-pipeline-connector-maxcompute-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.4.0/flink-cdc-pipeline-connector-maxcompute-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.3.0/flink-cdc-pipeline-connector-maxcompute-3.3.0.jar) | | ## Supported Flink Versions 下表展示了 Flink® CDC 管道连接器和 Flink® 之间的版本映射 @@ -50,6 +53,8 @@ Flink CDC 提供了可用于 YAML 作业的 Pipeline Source 和 Sink 连接器 | 3.1.x | 1.17.\*, 1.18.\*, 1.19.\* | Mysql | StarRocks,Doris,Paimon,Kafka | 仅 flink-cdc 3.1.1 支持 flink 1.19.* | | 3.2.x | 1.17.\*, 1.18.\*, 1.19.\* | Mysql | StarRocks,Doris,Paimon,Kafka,ElasticSearch | | | 3.3.x | 1.19.\*, 1.20.\* | Mysql | StarRocks,Doris,Paimon,Kafka,ElasticSearch,OceanBase,MaxCompute | | +| 3.4.x | 1.19.\*, 1.20.\* | Mysql | StarRocks,Doris,Paimon,Kafka,ElasticSearch,OceanBase,MaxCompute,Iceberg | | +| 3.5.x | 1.19.\*, 1.20.\* | Mysql, Postgres | StarRocks,Doris,Paimon,Kafka,ElasticSearch,OceanBase,MaxCompute,Iceberg,Fluss | | ## Develop Your Own Connector diff --git a/docs/content.zh/docs/get-started/quickstart/mysql-to-doris.md b/docs/content.zh/docs/get-started/quickstart/mysql-to-doris.md index 572c1cc4468..81b0f031d30 100644 --- a/docs/content.zh/docs/get-started/quickstart/mysql-to-doris.md +++ b/docs/content.zh/docs/get-started/quickstart/mysql-to-doris.md @@ -40,10 +40,12 @@ under the License. cd flink-1.20.1 ``` -2. 通过在 conf/flink-conf.yaml 配置文件追加下列参数开启 checkpoint,每隔 3 秒做一次 checkpoint。 +2. 通过在 conf/config.yaml 配置文件追加下列参数开启 checkpoint,每隔 3 秒做一次 checkpoint。 ```yaml - execution.checkpointing.interval: 3000 + execution: + checkpointing: + interval: 3s ``` 3. 使用下面的命令启动 Flink 集群。 diff --git a/docs/content.zh/docs/get-started/quickstart/mysql-to-kafka.md b/docs/content.zh/docs/get-started/quickstart/mysql-to-kafka.md index 3f0ee59a032..ba92a951bcf 100644 --- a/docs/content.zh/docs/get-started/quickstart/mysql-to-kafka.md +++ b/docs/content.zh/docs/get-started/quickstart/mysql-to-kafka.md @@ -46,7 +46,9 @@ under the License. 2. 在 `conf/config.yaml` 配置文件追加下列参数开启检查点,每隔 3 秒进行一次 checkpoint。 ```yaml - execution.checkpointing.interval: 3s + execution: + checkpointing: + interval: 3s ``` 3. 使用下面的命令启动 Flink 集群。 diff --git a/docs/content.zh/docs/get-started/quickstart/mysql-to-starrocks.md b/docs/content.zh/docs/get-started/quickstart/mysql-to-starrocks.md index 3f7eb3d12b3..7e14554552c 100644 --- a/docs/content.zh/docs/get-started/quickstart/mysql-to-starrocks.md +++ b/docs/content.zh/docs/get-started/quickstart/mysql-to-starrocks.md @@ -40,10 +40,12 @@ under the License. cd flink-1.20.1 ``` -2. 通过在 conf/flink-conf.yaml 配置文件追加下列参数开启 checkpoint,每隔 3 秒做一次 checkpoint。 +2. 通过在 conf/config.yaml 配置文件追加下列参数开启 checkpoint,每隔 3 秒做一次 checkpoint。 ```yaml - execution.checkpointing.interval: 3000 + execution: + checkpointing: + interval: 3s ``` 3. 使用下面的命令启动 Flink 集群。 diff --git a/docs/content/docs/connectors/flink-sources/overview.md b/docs/content/docs/connectors/flink-sources/overview.md index c275d54360c..a1855f3a489 100644 --- a/docs/content/docs/connectors/flink-sources/overview.md +++ b/docs/content/docs/connectors/flink-sources/overview.md @@ -65,7 +65,9 @@ The following table shows the version mapping between Flink® CDC Con | 3.0.* | 1.14.\*, 1.15.\*, 1.16.\*, 1.17.\*, 1.18.\* | | 3.1.* | 1.16.\*, 1.17.\*, 1.18.\*, 1.19.\* | | 3.2.* | 1.17.\*, 1.18.\*, 1.19.\*, 1.20.\* | -| 3.3.* | 1.19.\*, 1.20.\* | +| 3.3.* | 1.19.\*, 1.20.\* | +| 3.4.* | 1.19.\*, 1.20.\* | +| 3.5.* | 1.19.\*, 1.20.\* | ## Features diff --git a/docs/content/docs/connectors/pipeline-connectors/fluss.md b/docs/content/docs/connectors/pipeline-connectors/fluss.md index 9e3994ea40d..99902283b13 100644 --- a/docs/content/docs/connectors/pipeline-connectors/fluss.md +++ b/docs/content/docs/connectors/pipeline-connectors/fluss.md @@ -226,7 +226,7 @@ Data Type Mapping VARCHAR(n) - VARCHAR(n) + STRING diff --git a/docs/content/docs/connectors/pipeline-connectors/overview.md b/docs/content/docs/connectors/pipeline-connectors/overview.md index 29ff1902ff3..642fb24302a 100644 --- a/docs/content/docs/connectors/pipeline-connectors/overview.md +++ b/docs/content/docs/connectors/pipeline-connectors/overview.md @@ -35,14 +35,17 @@ definition. | Connector | Supported Type | External System | Download Page | |----------------------------------------------------------------------------------|----------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}}) | Sink |
  • [Apache Doris](https://doris.apache.org/): 1.2.x, 2.x.x, 3.x.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.3.0/flink-cdc-pipeline-connector-doris-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.1/flink-cdc-pipeline-connector-doris-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.0/flink-cdc-pipeline-connector-doris-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.1/flink-cdc-pipeline-connector-doris-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.0/flink-cdc-pipeline-connector-doris-3.1.0.jar) | -| [Elasticsearch]({{< ref "docs/connectors/pipeline-connectors/elasticsearch" >}}) | Sink |
  • [Elasticsearch](https://www.elastic.co/elasticsearch): 6.x, 7.x, 8.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.3.0/flink-cdc-pipeline-connector-elasticsearch-3.3.0.jar) | -| [Kafka]({{< ref "docs/connectors/pipeline-connectors/kafka" >}}) | Sink |
  • [Kafka](https://kafka.apache.org/) | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.3.0/flink-cdc-pipeline-connector-kafka-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.1/flink-cdc-pipeline-connector-kafka-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.0/flink-cdc-pipeline-connector-kafka-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.1/flink-cdc-pipeline-connector-kafka-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.0/flink-cdc-pipeline-connector-kafka-3.1.0.jar) | -| [MySQL]({{< ref "docs/connectors/pipeline-connectors/mysql" >}}) | Source |
  • [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x
  • [RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x
  • [PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x
  • [Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x
  • [MariaDB](https://mariadb.org): 10.x
  • [PolarDB X](https://github.com/ApsaraDB/galaxysql): 2.0.1 | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.3.0/flink-cdc-pipeline-connector-mysql-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.1/flink-cdc-pipeline-connector-mysql-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.0/flink-cdc-pipeline-connector-mysql-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.1/flink-cdc-pipeline-connector-mysql-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.0/flink-cdc-pipeline-connector-mysql-3.1.0.jar) | -| [OceanBase]({{< ref "docs/connectors/pipeline-connectors/oceanbase" >}}) | Sink |
  • [OceanBase](https://www.oceanbase.com/): 3.x, 4.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.3.0/flink-cdc-pipeline-connector-oceanbase-3.3.0.jar) | -| [Paimon]({{< ref "docs/connectors/pipeline-connectors/paimon" >}}) | Sink |
  • [Paimon](https://paimon.apache.org/): 0.6, 0.7, 0.8, 0.9, 1.0 | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.3.0/flink-cdc-pipeline-connector-paimon-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.1/flink-cdc-pipeline-connector-paimon-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.0/flink-cdc-pipeline-connector-paimon-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.1/flink-cdc-pipeline-connector-paimon-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.0/flink-cdc-pipeline-connector-paimon-3.1.0.jar) | -| [StarRocks]({{< ref "docs/connectors/pipeline-connectors/starrocks" >}}) | Sink |
  • [StarRocks](https://www.starrocks.io/): 2.x, 3.x | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.3.0/flink-cdc-pipeline-connector-starrocks-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.1/flink-cdc-pipeline-connector-starrocks-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.0/flink-cdc-pipeline-connector-starrocks-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.1/flink-cdc-pipeline-connector-starrocks-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.0/flink-cdc-pipeline-connector-starrocks-3.1.0.jar) | -| [MaxCompute]({{< ref "docs/connectors/pipeline-connectors/maxcompute" >}}) | Sink |
  • [MaxCompute](https://www.aliyun.com/product/maxcompute) | [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.3.0/flink-cdc-pipeline-connector-maxcompute-3.3.0.jar) | | +| [Apache Doris]({{< ref "docs/connectors/pipeline-connectors/doris" >}}) | Sink |
  • [Apache Doris](https://doris.apache.org/): 1.2.x, 2.x.x, 3.x.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.5.0/flink-cdc-pipeline-connector-doris-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.4.0/flink-cdc-pipeline-connector-doris-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.3.0/flink-cdc-pipeline-connector-doris-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.1/flink-cdc-pipeline-connector-doris-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.2.0/flink-cdc-pipeline-connector-doris-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.1/flink-cdc-pipeline-connector-doris-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-doris/3.1.0/flink-cdc-pipeline-connector-doris-3.1.0.jar) | +| [Elasticsearch]({{< ref "docs/connectors/pipeline-connectors/elasticsearch" >}}) | Sink |
  • [Elasticsearch](https://www.elastic.co/elasticsearch): 6.x, 7.x, 8.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.5.0/flink-cdc-pipeline-connector-elasticsearch-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.4.0/flink-cdc-pipeline-connector-elasticsearch-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-elasticsearch/3.3.0/flink-cdc-pipeline-connector-elasticsearch-3.3.0.jar) | +| [Iceberg]({{< ref "docs/connectors/pipeline-connectors/iceberg" >}}) | Sink |
  • [Apache Iceberg](https://iceberg.apache.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-iceberg/3.5.0/flink-cdc-pipeline-connector-iceberg-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-iceberg/3.4.0/flink-cdc-pipeline-connector-iceberg-3.4.0.jar) | +| [Fluss]({{< ref "docs/connectors/pipeline-connectors/fluss" >}}) | Sink |
  • [Fluss](https://fluss.apache.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-fluss/3.5.0/flink-cdc-pipeline-connector-fluss-3.5.0.jar) | +| [Kafka]({{< ref "docs/connectors/pipeline-connectors/kafka" >}}) | Sink |
  • [Kafka](https://kafka.apache.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.5.0/flink-cdc-pipeline-connector-kafka-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.4.0/flink-cdc-pipeline-connector-kafka-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.3.0/flink-cdc-pipeline-connector-kafka-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.1/flink-cdc-pipeline-connector-kafka-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.2.0/flink-cdc-pipeline-connector-kafka-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.1/flink-cdc-pipeline-connector-kafka-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-kafka/3.1.0/flink-cdc-pipeline-connector-kafka-3.1.0.jar) | +| [MySQL]({{< ref "docs/connectors/pipeline-connectors/mysql" >}}) | Source |
  • [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x
  • [RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x
  • [PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x
  • [Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x
  • [MariaDB](https://mariadb.org): 10.x
  • [PolarDB X](https://github.com/ApsaraDB/galaxysql): 2.0.1 | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.5.0/flink-cdc-pipeline-connector-mysql-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.4.0/flink-cdc-pipeline-connector-mysql-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.3.0/flink-cdc-pipeline-connector-mysql-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.1/flink-cdc-pipeline-connector-mysql-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.2.0/flink-cdc-pipeline-connector-mysql-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.1/flink-cdc-pipeline-connector-mysql-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-mysql/3.1.0/flink-cdc-pipeline-connector-mysql-3.1.0.jar) | +| [Postgres]({{< ref "docs/connectors/pipeline-connectors/postgres" >}}) | Source |
  • [PostgreSQL](https://www.postgresql.org/) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-postgres/3.5.0/flink-cdc-pipeline-connector-postgres-3.5.0.jar) | +| [OceanBase]({{< ref "docs/connectors/pipeline-connectors/oceanbase" >}}) | Sink |
  • [OceanBase](https://www.oceanbase.com/): 3.x, 4.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.5.0/flink-cdc-pipeline-connector-oceanbase-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.4.0/flink-cdc-pipeline-connector-oceanbase-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-oceanbase/3.3.0/flink-cdc-pipeline-connector-oceanbase-3.3.0.jar) | +| [Paimon]({{< ref "docs/connectors/pipeline-connectors/paimon" >}}) | Sink |
  • [Paimon](https://paimon.apache.org/): 0.6, 0.7, 0.8, 0.9, 1.0 | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.5.0/flink-cdc-pipeline-connector-paimon-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.4.0/flink-cdc-pipeline-connector-paimon-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.3.0/flink-cdc-pipeline-connector-paimon-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.1/flink-cdc-pipeline-connector-paimon-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.2.0/flink-cdc-pipeline-connector-paimon-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.1/flink-cdc-pipeline-connector-paimon-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-paimon/3.1.0/flink-cdc-pipeline-connector-paimon-3.1.0.jar) | +| [StarRocks]({{< ref "docs/connectors/pipeline-connectors/starrocks" >}}) | Sink |
  • [StarRocks](https://www.starrocks.io/): 2.x, 3.x | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.5.0/flink-cdc-pipeline-connector-starrocks-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.4.0/flink-cdc-pipeline-connector-starrocks-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.3.0/flink-cdc-pipeline-connector-starrocks-3.3.0.jar), [3.2.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.1/flink-cdc-pipeline-connector-starrocks-3.2.1.jar), [3.2.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.2.0/flink-cdc-pipeline-connector-starrocks-3.2.0.jar), [3.1.1](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.1/flink-cdc-pipeline-connector-starrocks-3.1.1.jar), [3.1.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-starrocks/3.1.0/flink-cdc-pipeline-connector-starrocks-3.1.0.jar) | +| [MaxCompute]({{< ref "docs/connectors/pipeline-connectors/maxcompute" >}}) | Sink |
  • [MaxCompute](https://www.aliyun.com/product/maxcompute) | [3.5.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.5.0/flink-cdc-pipeline-connector-maxcompute-3.5.0.jar), [3.4.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.4.0/flink-cdc-pipeline-connector-maxcompute-3.4.0.jar), [3.3.0](https://repo1.maven.org/maven2/org/apache/flink/flink-cdc-pipeline-connector-maxcompute/3.3.0/flink-cdc-pipeline-connector-maxcompute-3.3.0.jar) | | ## Supported Flink Versions @@ -54,6 +57,8 @@ The following table shows the version mapping between Flink® CDC Pip | 3.1.x | 1.17.\*, 1.18.\*, 1.19.\* | Mysql | StarRocks,Doris,Paimon,Kafka | only flink-cdc 3.1.1 support flink 1.19.* | | 3.2.x | 1.17.\*, 1.18.\*, 1.19.\* | Mysql | StarRocks,Doris,Paimon,Kafka,ElasticSearch | | | 3.3.x | 1.19.\*, 1.20.\* | Mysql | StarRocks,Doris,Paimon,Kafka,ElasticSearch,OceanBase,MaxCompute | | +| 3.4.x | 1.19.\*, 1.20.\* | Mysql | StarRocks,Doris,Paimon,Kafka,ElasticSearch,OceanBase,MaxCompute,Iceberg | | +| 3.5.x | 1.19.\*, 1.20.\* | Mysql, Postgres | StarRocks,Doris,Paimon,Kafka,ElasticSearch,OceanBase,MaxCompute,Iceberg,Fluss | | ## Develop Your Own Connector diff --git a/docs/content/docs/get-started/quickstart/mysql-to-doris.md b/docs/content/docs/get-started/quickstart/mysql-to-doris.md index 8c3ed53ef35..d28c820d0ac 100644 --- a/docs/content/docs/get-started/quickstart/mysql-to-doris.md +++ b/docs/content/docs/get-started/quickstart/mysql-to-doris.md @@ -42,10 +42,12 @@ Prepare a Linux or MacOS computer with Docker installed. cd flink-1.20.1 ``` -2. Enable checkpointing by appending the following parameters to the conf/flink-conf.yaml configuration file to perform a checkpoint every 3 seconds. +2. Enable checkpointing by appending the following parameters to the conf/config.yaml configuration file to perform a checkpoint every 3 seconds. ```yaml - execution.checkpointing.interval: 3000 + execution: + checkpointing: + interval: 3s ``` 3. Start the Flink cluster using the following command. diff --git a/docs/content/docs/get-started/quickstart/mysql-to-kafka.md b/docs/content/docs/get-started/quickstart/mysql-to-kafka.md index ac9b711fc73..8d16d073e77 100644 --- a/docs/content/docs/get-started/quickstart/mysql-to-kafka.md +++ b/docs/content/docs/get-started/quickstart/mysql-to-kafka.md @@ -48,7 +48,9 @@ You need a Linux or macOS computer with Docker installed before starting. 2. Enable checkpointing by appending the following parameters to the `conf/config.yaml` configuration file to perform a checkpoint every 3 seconds. ```yaml - execution.checkpointing.interval: 3s + execution: + checkpointing: + interval: 3s ``` 3. Start the Flink cluster using the following command. diff --git a/docs/content/docs/get-started/quickstart/mysql-to-starrocks.md b/docs/content/docs/get-started/quickstart/mysql-to-starrocks.md index 0fa4d7a5e41..1a32cb9c440 100644 --- a/docs/content/docs/get-started/quickstart/mysql-to-starrocks.md +++ b/docs/content/docs/get-started/quickstart/mysql-to-starrocks.md @@ -42,10 +42,12 @@ Prepare a Linux or MacOS computer with Docker installed. cd flink-1.20.1 ``` -2. Enable checkpointing by appending the following parameters to the conf/flink-conf.yaml configuration file to perform a checkpoint every 3 seconds. +2. Enable checkpointing by appending the following parameters to the conf/config.yaml configuration file to perform a checkpoint every 3 seconds. ```yaml - execution.checkpointing.interval: 3000 + execution: + checkpointing: + interval: 3s ``` 3. Start the Flink cluster using the following command.