🔥 multi/data-center-mirrormaker2 #7418
Description
🆕💥 New issue !
🔥 CP 8.1.1 🕐 2025-12-04 08:42 📄 mirrormaker2-plaintext.sh 🔗 https://github.com/vdesabou/kafka-docker-playground/actions/runs/19921980533/job/57113131334
Logs
08:36:51 ℹ️ 💀 kill all docker containers (disable with 'playground config container-kill-all-before-run false')
08:36:51 ℹ️ 💀 kill all docker containers
Unable to find image 'ddev/ddev-utilities:latest' locally
latest: Pulling from ddev/ddev-utilities
43c4264eed91: Pulling fs layer
134d3819e0e6: Pulling fs layer
43c4264eed91: Verifying Checksum
43c4264eed91: Download complete
134d3819e0e6: Verifying Checksum
134d3819e0e6: Download complete
43c4264eed91: Pull complete
134d3819e0e6: Pull complete
Digest: sha256:97822ff9a06416ea8ba09853427565b351556fb08a3b1ef944101fcf829b2710
Status: Downloaded newer image for ddev/ddev-utilities:latest
08:36:53 ℹ️ 🚀 Running example with flags
08:36:53 ℹ️ ⛳ Flags used are --tag=8.1.1
08:36:54 ℹ️ 🚀 Number of examples ran so far: 1
08:36:55 ℹ️ 🤖CI status: 🟢 ok
🔗test url: https://github.com/vdesabou/kafka-docker-playground/actions/runs/19802914128/job/56733006803
08:36:55 ℹ️ ####################################################
08:36:55 ℹ️ 🚀 Executing mirrormaker2-plaintext.sh in dir /home/runner/work/kafka-docker-playground/kafka-docker-playground/multi-data-center/mirrormaker2
08:36:55 ℹ️ ####################################################
08:36:55 ℹ️ 🧰 Checking if Docker image confluentinc/cp-server-connect-base:8.1.1 contains additional tools
08:36:55 ℹ️ ⏳ it can take a while if image is downloaded for the first time
08:36:55 ℹ️ 🛰️ Starting up Confluent Platform in Kraft mode as ENABLE_KRAFT environment variable is set
08:36:55 ℹ️ 🧰 Checking if Docker image confluentinc/cp-server-connect-base:8.1.1 contains additional tools
08:36:55 ℹ️ ⏳ it can take a while if image is downloaded for the first time
08:36:55 ℹ️ 🛰️ Starting up Confluent Platform in Kraft mode as ENABLE_KRAFT environment variable is set
08:36:56 ℹ️ 🛑 zookeeper is disabled
08:36:56 ℹ️ 🛑 control-center is disabled
08:36:56 ℹ️ 🛑 Starting services without Flink
08:36:56 ℹ️ 🛑 ksqldb is disabled
08:36:56 ℹ️ 🛑 REST Proxy is disabled
08:36:57 ℹ️ 🛑 Grafana is disabled
08:36:57 ℹ️ 🛑 kcat is disabled
08:36:57 ℹ️ 🛑 conduktor is disabled
08:36:57 ℹ️ 🎱 Installing replicator confluentinc/kafka-connect-replicator:8.1.1 for Replicator Monitoring
Running in a "--no-prompt" mode
Unable to find a component
Error: Component not found, specify either valid name from Confluent Hub in format: /:version:latest or path to a local file
08:36:59 ❗ Installing replicator confluentinc/kafka-connect-replicator:8.1.1 failed, trying now with default tag 8.1.0
Running in a "--no-prompt" mode
Implicit acceptance of the license below:
Confluent Software Evaluation License
https://www.confluent.io/software-evaluation-license
Downloading component Confluent Kafka Replicator 8.1.0, provided by Confluent, Inc. from Confluent Hub and installing into /usr/share/confluent-hub-components
Adding installation directory to plugin path in the following files:
/etc/kafka/connect-distributed.properties
/etc/kafka/connect-standalone.properties
/etc/schema-registry/connect-avro-distributed.properties
/etc/schema-registry/connect-avro-standalone.properties
Completed
controller-us Pulling
alertmanager-c3-v2 Pulling
prometheus-c3-v2 Pulling
schema-registry-us Pulling
controller-metrics Pulling
broker-us Pulling
broker-metrics Pulling
broker-europe Pulling
schema-registry-europe Pulling
controller-europe Pulling
broker-metrics Pulled
controller-metrics Pulled
controller-us Pulled
broker-europe Pulled
controller-europe Pulled
broker-us Pulled
alertmanager-c3-v2 Pulled
prometheus-c3-v2 Pulled
schema-registry-europe Pulled
schema-registry-us Pulled
Network mdc-plaintext_default Creating
Network mdc-plaintext_default Created
Container controller-us Creating
Container prometheus-c3-v2 Creating
Container controller-europe Creating
Container controller-metrics Creating
Container controller-us Created
Container prometheus-c3-v2 Created
Container alertmanager-c3-v2 Creating
Container controller-metrics Created
Container broker-metrics Creating
Container controller-europe Created
Container alertmanager-c3-v2 Created
Container broker-metrics Created
Container broker-us Creating
Container broker-europe Creating
Container broker-europe Created
Container schema-registry-europe Creating
Container broker-us Created
Container connect-europe Creating
Container connect-us Creating
Container schema-registry-us Creating
Container schema-registry-europe Created
Container schema-registry-us Created
Container connect-europe Created
Container connect-us Created
Container controller-metrics Starting
Container prometheus-c3-v2 Starting
Container controller-us Starting
Container controller-europe Starting
Container controller-europe Started
Container controller-us Started
Container controller-metrics Started
Container broker-metrics Starting
Container prometheus-c3-v2 Started
Container alertmanager-c3-v2 Starting
Container broker-metrics Started
Container broker-us Starting
Container broker-europe Starting
Container alertmanager-c3-v2 Started
Container broker-europe Started
Container schema-registry-europe Starting
Container connect-europe Starting
Container broker-us Started
Container connect-us Starting
Container schema-registry-us Starting
Container schema-registry-us Started
Container schema-registry-europe Started
Container connect-europe Started
Container connect-us Started
08:37:13 ℹ️ 📝 To see the actual properties file, use cli command 'playground container get-properties -c '
08:37:14 ℹ️ ✨ If you modify a docker-compose file and want to re-create the container(s), run cli command 'playground container recreate'
08:37:14 ℹ️ ⌛ Waiting up to 300 seconds for connect-us to start
08:42:23 🔥 ❌ the connect REST API is still not ready after 300 seconds, see output
08:42:23 🔥 ####################################################
08:42:23 🔥 🔥 RESULT: FAILURE for mirrormaker2-plaintext.sh (took: 5min 28sec - )
08:42:23 🔥 ####################################################
08:42:23 ℹ️ 🧑🚒 you can troubleshoot the issue by running:
playground container display-error-all-containers
08:42:23 ℹ️ 🧑🚒 open full logs with '<playground container logs --open --container ', example:
playground container logs --open --container connect
08:42:26 🔥 💀 The test mirrormaker2-plaintext.sh (default_retry) has failed after 1 attempts.
08:42:26 🔥 ####################################################
08:42:26 🔥 🐳 docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
018e2278dc43 amazon/aws-cli "/usr/local/bin/aws …" 1 second ago Up 1 second beautiful_shirley
01c5d9872574 confluentinc/cp-schema-registry:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 0.0.0.0:28081->8081/tcp, [::]:28081->8081/tcp schema-registry-us
40322cf5f65c confluentinc/cp-schema-registry:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 0.0.0.0:18081->8081/tcp, [::]:18081->8081/tcp schema-registry-europe
bb6a2fe0ca8b confluentinc/cp-server:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 9092/tcp broker-europe
4365a08a74f7 confluentinc/cp-server:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 9092/tcp broker-us
c6649a992973 confluentinc/cp-server:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 9092/tcp broker-metrics
aca2edceaeb4 confluentinc/cp-enterprise-alertmanager:2.0.0 "alertmanager-start …" 5 minutes ago Up 5 minutes 9093/tcp alertmanager-c3-v2
edcc26daa80b confluentinc/cp-server:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 9092/tcp controller-metrics
429aae9974bc confluentinc/cp-server:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 9092/tcp controller-us
ebc63561b1f2 confluentinc/cp-server:8.1.1 "/etc/confluent/dock…" 5 minutes ago Up 5 minutes 9092/tcp controller-europe
ed55311aae79 confluentinc/cp-enterprise-prometheus:2.0.0 "prometheus-start --…" 5 minutes ago Up 5 minutes 9090/tcp prometheus-c3-v2
08:42:26 🔥 ####################################################
08:42:26 🔥 ####################################################
08:42:26 🔥 beautiful_shirley logs
08:42:26 ❗ ####################################################
08:42:26 🔥 ####################################################
08:42:26 🔥 schema-registry-us logs
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 schema-registry-europe logs
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 broker-europe logs
[2025-12-04 08:37:42,771] ERROR Cluster link metadata topic creation failed: org.apache.kafka.common.errors.InvalidReplicationFactorException: Unable to replicate the partition 3 time(s): The target replication factor of 3 cannot be reached because only 1 broker(s) are registered. (kafka.server.link.K1LinkCoordinatorManager)
[2025-12-04 08:37:42,771] ERROR Cluster link metadata topic creation failed: org.apache.kafka.common.errors.InvalidReplicationFactorException: Unable to replicate the partition 3 time(s): The target replication factor of 3 cannot be reached because only 1 broker(s) are registered. (kafka.server.link.K1LinkCoordinatorManager)
[2025-12-04 08:37:46,334] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
[2025-12-04 08:37:46,345] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 broker-us logs
[2025-12-04 08:37:43,428] ERROR Cluster link metadata topic creation failed: org.apache.kafka.common.errors.InvalidReplicationFactorException: Unable to replicate the partition 3 time(s): The target replication factor of 3 cannot be reached because only 1 broker(s) are registered. (kafka.server.link.K1LinkCoordinatorManager)
[2025-12-04 08:37:43,428] ERROR Cluster link metadata topic creation failed: org.apache.kafka.common.errors.InvalidReplicationFactorException: Unable to replicate the partition 3 time(s): The target replication factor of 3 cannot be reached because only 1 broker(s) are registered. (kafka.server.link.K1LinkCoordinatorManager)
[2025-12-04 08:37:46,660] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
[2025-12-04 08:37:46,671] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 broker-metrics logs
[2025-12-04 08:37:43,293] ERROR Cluster link metadata topic creation failed: org.apache.kafka.common.errors.InvalidReplicationFactorException: Unable to replicate the partition 3 time(s): The target replication factor of 3 cannot be reached because only 1 broker(s) are registered. (kafka.server.link.K1LinkCoordinatorManager)
[2025-12-04 08:37:43,293] ERROR Cluster link metadata topic creation failed: org.apache.kafka.common.errors.InvalidReplicationFactorException: Unable to replicate the partition 3 time(s): The target replication factor of 3 cannot be reached because only 1 broker(s) are registered. (kafka.server.link.K1LinkCoordinatorManager)
[2025-12-04 08:37:45,609] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
[2025-12-04 08:37:45,618] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 alertmanager-c3-v2 logs
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 controller-metrics logs
[2025-12-04 08:37:42,394] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 controller-us logs
[2025-12-04 08:37:40,628] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 controller-europe logs
[2025-12-04 08:37:41,039] ERROR Unable to submit events without credentials (io.confluent.telemetry.events.exporter.http.HttpExporter)
08:42:27 ❗ ####################################################
08:42:27 🔥 ####################################################
08:42:27 🔥 prometheus-c3-v2 logs
08:42:27 ❗ ####################################################