Kafka topic not created after applied kafkatopic yaml

[jackkuo17live]

When I apply the kafkatopic yaml file such as belowing:

apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaTopic
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"apiVersion":"kafka.strimzi.io/v1beta2","kind":"KafkaTopic","metadata":{"annotations":{},"labels":{"strimzi.io/cluster":"rose-cluster"},"name":"matomo-02","namespace":"stage-kafka"},"spec":{"partitions":3,
"replicas":3}}
  creationTimestamp: "2022-01-17T08:44:07Z"
  generation: 2
  labels:
    strimzi.io/cluster: rose-cluster
  name: matomo-02
  namespace: stage-kafka
  resourceVersion: "201033729"
  selfLink: /apis/kafka.strimzi.io/v1beta2/namespaces/stage-kafka/kafkatopics/matomo-02
  uid: 706e2cbd-f50a-4b5c-bef5-351b81dc57dd
spec:
  partitions: 6
  replicas: 6

I use k9s tool and use :kafkatopic command. I see the topic is created.
But I use a kafka monitor tool called kowl I can't find the topic.
And I get the following error(which is in strimzi-cluster-operator deployment):

2022-01-18 11:29:59 INFO  KafkaRoller:292 - Reconciliation #15(timer) Kafka(stage-kafka/rose-cluster): Could not roll pod 1, giving up after 10 attempts. Total delay between attempts 127750ms
io.strimzi.operator.cluster.operator.resource.KafkaRoller$UnforceableProblem: Pod rose-cluster-kafka-1 is currently not rollable
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.restartIfNecessary(KafkaRoller.java:370) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.lambda$schedule$6(KafkaRoller.java:277) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
    at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
    at java.lang.Thread.run(Thread.java:829) [?:?]
2022-01-18 11:30:00 INFO  KafkaAvailability:125 - Reconciliation #15(timer) Kafka(stage-kafka/rose-cluster): matomo-forward/2 will be underreplicated (|ISR|=2 and min.insync.replicas=2) if broker 2 is restarted.
2022-01-18 11:30:00 INFO  KafkaRoller:292 - Reconciliation #15(timer) Kafka(stage-kafka/rose-cluster): Could not roll pod 2, giving up after 10 attempts. Total delay between attempts 127750ms
io.strimzi.operator.cluster.operator.resource.KafkaRoller$UnforceableProblem: Pod rose-cluster-kafka-2 is currently not rollable
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.restartIfNecessary(KafkaRoller.java:370) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.lambda$schedule$6(KafkaRoller.java:277) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
    at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
    at java.lang.Thread.run(Thread.java:829) [?:?]
2022-01-18 11:30:00 ERROR AbstractOperator:240 - Reconciliation #15(timer) Kafka(stage-kafka/rose-cluster): createOrUpdate failed
io.strimzi.operator.cluster.operator.resource.KafkaRoller$ForceableProblem: Pod rose-cluster-kafka-0 is currently the controller and there are other pods still to roll
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.restartIfNecessary(KafkaRoller.java:358) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.lambda$schedule$6(KafkaRoller.java:277) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
    at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
    at java.lang.Thread.run(Thread.java:829) [?:?]
2022-01-18 11:30:00 WARN  AbstractOperator:481 - Reconciliation #15(timer) Kafka(stage-kafka/rose-cluster): Failed to reconcile
io.strimzi.operator.cluster.operator.resource.KafkaRoller$ForceableProblem: Pod rose-cluster-kafka-0 is currently the controller and there are other pods still to roll
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.restartIfNecessary(KafkaRoller.java:358) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at io.strimzi.operator.cluster.operator.resource.KafkaRoller.lambda$schedule$6(KafkaRoller.java:277) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
    at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
    at java.lang.Thread.run(Thread.java:829) [?:?]
2022-01-18 11:31:47 INFO  ClusterOperator:118 - Triggering periodic reconciliation for namespace stage-kafka
2022-01-18 11:31:47 INFO  AbstractOperator:219 - Reconciliation #17(timer) Kafka(stage-kafka/rose-cluster): Kafka rose-cluster will be checked for creation or modification
2022-01-18 11:31:50 INFO  KafkaRoller:299 - Reconciliation #17(timer) Kafka(stage-kafka/rose-cluster): Could not roll pod 0 due to io.strimzi.operator.cluster.operator.resource.KafkaRoller$ForceableProblem: Pod r
ose-cluster-kafka-0 is currently the controller and there are other pods still to roll, retrying after at least 250ms

k9s screenshot:

kowl screencshot

[scholzj]

That error suggests that the broker cannot be rolled. Possibly due to some replicas not being in-sync? B ut could be other reasons as well. DEBUG level logging should give you more details if needed.