ZooKeeperAdmin TimeoutException

[stuartm21]

Hi @scholzj Our Kafka cluster was running fine without any issues, but today morning it is not working. So I tried to recreate the Kafka cluster, the zookeer pod is coming up, but the Kafka pod is not coming. So I pull the logs from the cluster operator, that I am pasting here:

2022-03-22 12:12:42 WARN  AbstractOperator:532 - Reconciliation #118(timer) Kafka(kafka/strimzi): Failed to reconcile
io.strimzi.operator.cluster.operator.resource.ZookeeperScalingException: Failed to connect to Zookeeper strimzi-zookeeper-0.strimzi-zookeeper-nodes.kafka.svc:2181. Connection was not ready in 300000 ms.
	at io.strimzi.operator.cluster.operator.resource.ZookeeperScaler.lambda$connect$7(ZookeeperScaler.java:174) ~[io.strimzi.cluster-operator-0.28.0.jar:0.28.0]
	at io.vertx.core.impl.future.FutureImpl$3.onSuccess(FutureImpl.java:141) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]
	at io.vertx.core.impl.future.FutureBase.emitSuccess(FutureBase.java:60) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]
	at io.vertx.core.impl.future.FutureImpl.tryComplete(FutureImpl.java:211) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]
	at io.vertx.core.impl.future.PromiseImpl.tryComplete(PromiseImpl.java:23) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]
	at io.vertx.core.impl.future.PromiseImpl.onSuccess(PromiseImpl.java:49) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]
	at io.vertx.core.impl.future.FutureBase.lambda$emitSuccess$0(FutureBase.java:54) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]
	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:469) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:503) [io.netty.netty-transport-4.1.71.Final.jar:4.1.71.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty.netty-common-4.1.71.Final.jar:4.1.71.Final]
	at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: io.strimzi.operator.common.operator.resource.TimeoutException: Exceeded timeout of 300000ms while waiting for ZooKeeperAdmin connection to strimzi-zookeeper-0.strimzi-zookeeper-nodes.kafka.svc:2181 to be connected
	at io.strimzi.operator.common.Util$1.lambda$handle$1(Util.java:150) ~[io.strimzi.operator-common-0.28.0.jar:0.28.0]
	at io.vertx.core.impl.future.FutureImpl$3.onFailure(FutureImpl.java:153) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]
	at io.vertx.core.impl.future.FutureBase.lambda$emitFailure$1(FutureBase.java:69) ~[io.vertx.vertx-core-4.2.4.jar:4.2.4]

I don't know what is wrong here. Everything was worked before

[scholzj]

That means that the operator cannot connect to the ZooKeeper cluster.

[stuartm21]

@scholzj But the operator and zookeeper are installed on the same namespace. How can we solve the issue?

[scholzj]

You shared just a single exception. So all I can tell you is what the exception means. Thats it. You would need to check and share the full logs from all the different components and then maybe someone can tell you what the issue is.