KafkaTopics topics not ready

[aamargant]

Hello,

I have three zookeepers, three brokers and created some topics with TopicOperator on the entityOperator but only 7 of the 10 topics are being configured.

When I get the KafkaTopics object I get the following:

NAME                                                             CLUSTER   PARTITIONS   REPLICATION FACTOR   READY
connect-configs-pfx---5126fa0f0b6e0b7a2c32ba6df5d0a015fa1772eb   kafka     1            1                    True
connect-offsets-pfx---f8101831aedbae6efe2166b5bd750d8bec4d3c27   kafka     1            1                    True
connect-status-pfx---6f770d5cab7d6e6c16752e3c0c08d5869c953187    kafka     1            1                    True
events-info-oxf                                                  kafka     12           1                    True
events-info-simux                                                kafka     12           1
events-oxf                                                       kafka     12           1
events-oxfcs                                                     kafka     12           1                    True
events-oxffe                                                     kafka     12           1                    True
events-simux                                                     kafka     12           1
pfxdata-mutation                                                 kafka     12           1                    True

These are the states of the kafka pods

kafka-kafka-0                                       1/1     Running             0          6h19m
kafka-kafka-1                                       1/1     Running             0          6h19m
kafka-kafka-2                                       1/1     Running             0          6h19m
kafka-zookeeper-0                                   1/1     Running             0          6h30m
kafka-zookeeper-1                                   1/1     Running             0          6h30m
kafka-zookeeper-2                                   1/1     Running             0          6h30m
strimzi-cluster-operator-7fc6fbf995-ndbb8           1/1     Running             0          6h31m
kafka-entity-operator-d78d49646-mzstr               3/3     Running             0          5h31m

These are the debug logs of the TopicOperator:
TopicOperatorDebugLogs.txt

Yaml of the kafkaTopic:

apiVersion: v1
items:
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    creationTimestamp: "2022-05-18T14:50:58Z"
    generation: 1
    labels:
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T14:50:58Z"
    name: connect-configs-pfx---5126fa0f0b6e0b7a2c32ba6df5d0a015fa1772eb
    namespace: default
    resourceVersion: "1046422"
    uid: 1e8dbbfa-0263-4691-a75c-f45b480213dd
  spec:
    config: {}
    partitions: 1
    replicas: 1
    topicName: connect-configs-PFX
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T14:50:58.075049Z"
      status: "True"
      type: Ready
    observedGeneration: 1
    topicName: connect-configs-PFX
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    creationTimestamp: "2022-05-18T14:50:57Z"
    generation: 1
    labels:
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T14:50:57Z"
    name: connect-offsets-pfx---f8101831aedbae6efe2166b5bd750d8bec4d3c27
    namespace: default
    resourceVersion: "1046411"
    uid: 8ca594c1-36ea-45ab-9506-c1ebd9b1c341
  spec:
    config: {}
    partitions: 1
    replicas: 1
    topicName: connect-offsets-PFX
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T14:50:57.298975Z"
      status: "True"
      type: Ready
    observedGeneration: 1
    topicName: connect-offsets-PFX
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    creationTimestamp: "2022-05-18T14:50:57Z"
    generation: 1
    labels:
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T14:50:57Z"
    name: connect-status-pfx---6f770d5cab7d6e6c16752e3c0c08d5869c953187
    namespace: default
    resourceVersion: "1046419"
    uid: 5037f134-5e03-46c7-a5ec-1fc3abf427ea
  spec:
    config: {}
    partitions: 1
    replicas: 1
    topicName: connect-status-PFX
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T14:50:57.804139Z"
      status: "True"
      type: Ready
    observedGeneration: 1
    topicName: connect-status-PFX
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    annotations:
      meta.helm.sh/release-name: rbox
      meta.helm.sh/release-namespace: default
    creationTimestamp: "2022-05-18T08:18:42Z"
    generation: 1
    labels:
      app.kubernetes.io/managed-by: Helm
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:meta.helm.sh/release-name: {}
            f:meta.helm.sh/release-namespace: {}
          f:labels:
            .: {}
            f:app.kubernetes.io/managed-by: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config:
            .: {}
            f:retention.ms: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
      manager: helm
      operation: Update
      time: "2022-05-18T08:18:42Z"
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T08:34:25Z"
    name: events-info-oxf
    namespace: default
    resourceVersion: "819528"
    uid: 81e770b7-63ee-4c5c-bd53-b023a358a16c
  spec:
    config:
      retention.ms: 540000
    partitions: 12
    replicas: 1
    topicName: events.info.oxf
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T08:34:25.859263Z"
      status: "True"
      type: Ready
    observedGeneration: 1
    topicName: events.info.oxf
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    annotations:
      meta.helm.sh/release-name: rbox
      meta.helm.sh/release-namespace: default
    creationTimestamp: "2022-05-18T08:18:42Z"
    generation: 1
    labels:
      app.kubernetes.io/managed-by: Helm
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:meta.helm.sh/release-name: {}
            f:meta.helm.sh/release-namespace: {}
          f:labels:
            .: {}
            f:app.kubernetes.io/managed-by: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config:
            .: {}
            f:retention.ms: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
      manager: helm
      operation: Update
      time: "2022-05-18T08:18:42Z"
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T08:34:20Z"
    name: events-info-simux
    namespace: default
    resourceVersion: "819483"
    uid: e4c06510-f849-4f85-b8a9-d1e5975a7a43
  spec:
    config:
      retention.ms: 540000
    partitions: 12
    replicas: 1
    topicName: events.info.simux
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T08:34:20.260228Z"
      message: 'Failure executing: GET at: https://10.224.0.1/apis/kafka.strimzi.io/v1beta2/namespaces/default/kafkatopics/events.info.simux. Message: kafkatopics.kafka.strimzi.io "events.info.simux" not found. Received status: Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=kafka.strimzi.io, kind=kafkatopics, name=events.info.simux, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=kafkatopics.kafka.strimzi.io "events.info.simux" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={}).'
      reason: KubernetesClientException
      status: "True"
      type: NotReady
    observedGeneration: 1
    topicName: events.info.simux
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    annotations:
      meta.helm.sh/release-name: rbox
      meta.helm.sh/release-namespace: default
    creationTimestamp: "2022-05-18T08:18:42Z"
    generation: 1
    labels:
      app.kubernetes.io/managed-by: Helm
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:meta.helm.sh/release-name: {}
            f:meta.helm.sh/release-namespace: {}
          f:labels:
            .: {}
            f:app.kubernetes.io/managed-by: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config:
            .: {}
            f:retention.ms: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
      manager: helm
      operation: Update
      time: "2022-05-18T08:18:42Z"
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T08:34:20Z"
    name: events-oxf
    namespace: default
    resourceVersion: "819482"
    uid: 0d892cd0-fffa-4286-a5bc-1e56dc5c6f92
  spec:
    config:
      retention.ms: 540000
    partitions: 12
    replicas: 1
    topicName: events.oxf
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T08:34:20.238026Z"
      message: 'Failure executing: GET at: https://10.224.0.1/apis/kafka.strimzi.io/v1beta2/namespaces/default/kafkatopics/events.oxf. Message: kafkatopics.kafka.strimzi.io "events.oxf" not found. Received status: Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=kafka.strimzi.io, kind=kafkatopics, name=events.oxf, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=kafkatopics.kafka.strimzi.io "events.oxf" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={}).'
      reason: KubernetesClientException
      status: "True"
      type: NotReady
    observedGeneration: 1
    topicName: events.oxf
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    annotations:
      meta.helm.sh/release-name: rbox
      meta.helm.sh/release-namespace: default
    creationTimestamp: "2022-05-18T08:18:43Z"
    generation: 1
    labels:
      app.kubernetes.io/managed-by: Helm
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:meta.helm.sh/release-name: {}
            f:meta.helm.sh/release-namespace: {}
          f:labels:
            .: {}
            f:app.kubernetes.io/managed-by: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config:
            .: {}
            f:retention.ms: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
      manager: helm
      operation: Update
      time: "2022-05-18T08:18:43Z"
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T08:34:26Z"
    name: events-oxfcs
    namespace: default
    resourceVersion: "819532"
    uid: d2972ec6-2b27-4f8a-80a5-d68adb1a0d7e
  spec:
    config:
      retention.ms: 540000
    partitions: 12
    replicas: 1
    topicName: events.oxfcs
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T08:34:26.029647Z"
      status: "True"
      type: Ready
    observedGeneration: 1
    topicName: events.oxfcs
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    annotations:
      meta.helm.sh/release-name: rbox
      meta.helm.sh/release-namespace: default
    creationTimestamp: "2022-05-18T08:18:43Z"
    generation: 1
    labels:
      app.kubernetes.io/managed-by: Helm
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:meta.helm.sh/release-name: {}
            f:meta.helm.sh/release-namespace: {}
          f:labels:
            .: {}
            f:app.kubernetes.io/managed-by: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config:
            .: {}
            f:retention.ms: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
      manager: helm
      operation: Update
      time: "2022-05-18T08:18:43Z"
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T08:34:25Z"
    name: events-oxffe
    namespace: default
    resourceVersion: "819529"
    uid: a1c942a5-1e4a-47c0-9c6c-c65f82bede88
  spec:
    config:
      retention.ms: 540000
    partitions: 12
    replicas: 1
    topicName: events.oxffe
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T08:34:25.869896Z"
      status: "True"
      type: Ready
    observedGeneration: 1
    topicName: events.oxffe
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    annotations:
      meta.helm.sh/release-name: rbox
      meta.helm.sh/release-namespace: default
    creationTimestamp: "2022-05-18T08:18:43Z"
    generation: 1
    labels:
      app.kubernetes.io/managed-by: Helm
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:meta.helm.sh/release-name: {}
            f:meta.helm.sh/release-namespace: {}
          f:labels:
            .: {}
            f:app.kubernetes.io/managed-by: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config:
            .: {}
            f:retention.ms: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
      manager: helm
      operation: Update
      time: "2022-05-18T08:18:43Z"
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T08:34:20Z"
    name: events-simux
    namespace: default
    resourceVersion: "819486"
    uid: 48087676-a705-4746-bf2b-e6830131cbdc
  spec:
    config:
      retention.ms: 540000
    partitions: 12
    replicas: 1
    topicName: events.simux
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T08:34:20.332474Z"
      message: 'Failure executing: GET at: https://10.224.0.1/apis/kafka.strimzi.io/v1beta2/namespaces/default/kafkatopics/events.simux. Message: kafkatopics.kafka.strimzi.io "events.simux" not found. Received status: Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=kafka.strimzi.io, kind=kafkatopics, name=events.simux, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=kafkatopics.kafka.strimzi.io "events.simux" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={}).'
      reason: KubernetesClientException
      status: "True"
      type: NotReady
    observedGeneration: 1
    topicName: events.simux
- apiVersion: kafka.strimzi.io/v1beta2
  kind: KafkaTopic
  metadata:
    annotations:
      meta.helm.sh/release-name: rbox
      meta.helm.sh/release-namespace: default
    creationTimestamp: "2022-05-18T08:18:43Z"
    generation: 1
    labels:
      app.kubernetes.io/managed-by: Helm
      strimzi.io/cluster: kafka
    managedFields:
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:meta.helm.sh/release-name: {}
            f:meta.helm.sh/release-namespace: {}
          f:labels:
            .: {}
            f:app.kubernetes.io/managed-by: {}
            f:strimzi.io/cluster: {}
        f:spec:
          .: {}
          f:config:
            .: {}
            f:retention.ms: {}
          f:partitions: {}
          f:replicas: {}
          f:topicName: {}
      manager: helm
      operation: Update
      time: "2022-05-18T08:18:43Z"
    - apiVersion: kafka.strimzi.io/v1beta2
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:conditions: {}
          f:observedGeneration: {}
          f:topicName: {}
      manager: okhttp
      operation: Update
      time: "2022-05-18T08:34:25Z"
    name: pfxdata-mutation
    namespace: default
    resourceVersion: "1051075"
    uid: 51224f6b-cccd-4d20-988a-2c41d071d205
  spec:
    config:
      retention.ms: 3600000
    partitions: 12
    replicas: 1
    topicName: pfxdata.mutation
  status:
    conditions:
    - lastTransitionTime: "2022-05-18T14:57:22.337904Z"
      status: "True"
      type: Ready
    observedGeneration: 1
    topicName: pfxdata.mutation
kind: List
metadata:
  resourceVersion: ""
  selfLink: ""

The spec of the topics in the brokers are these:

Topic: pfxdata.mutation TopicId: KhK-wb66SEGBGFuEVeO76w PartitionCount: 12      ReplicationFactor: 1    Configs: retention.ms=3600000,message.format.version=3.0-IV1
Topic: uha_metrics      TopicId: 2N2FE_7-QSuBPeKTid4HIw PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: connect-configs-PFX      TopicId: Lx-tU7QiSL6WzHdM_1OyCA PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: __strimzi_store_topic    TopicId: 4hz-Hv6WTr6eznqfkdwPFg PartitionCount: 1       ReplicationFactor: 3    Configs: min.insync.replicas=2,message.format.version=3.0-IV1
Topic: events.oxffe     TopicId: _zCLJEJgSI2j9eBRljEoFA PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: pfxdata-mutation TopicId: UxJUekiSTsuKZrq_9S5rXw PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: events.oxf       TopicId: bKI_QtvTRHitGwATrBodaQ PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: connect-status-PFX       TopicId: EngybyJmQmWLzf5UfZ9ywg PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: events.oxfcs     TopicId: 5RbouRMURAaxCIVUHGCB4A PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: __strimzi-topic-operator-kstreams-topic-store-changelog  TopicId: JB-uZFw-TrqnrfDUm9oi2A PartitionCount: 1       ReplicationFactor: 1    Configs: cleanup.policy=compact,segment.bytes=67108864,message.format.version=3.0-IV1,min.compaction.lag.ms=0,message.timestamp.type=CreateTime
Topic: events.info.oxf  TopicId: 6Y6pNBm_RRyRtPbkU-F6zA PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: events.info.simux        TopicId: kpot96heRKG7msj2QZrF1g PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: connect-offsets-PFX      TopicId: yAVwlA4cRFCpBG2WJ1DlKw PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1
Topic: __consumer_offsets       TopicId: WSRaGhAjTtuJrkCmhWct4w PartitionCount: 50      ReplicationFactor: 2    Configs: compression.type=producer,cleanup.policy=compact,segment.bytes=104857600,message.format.version=3.0-IV1
Topic: events.simux     TopicId: T1mTK0prQ4uE1VVTuiPeRQ PartitionCount: 1       ReplicationFactor: 1    Configs: message.format.version=3.0-IV1

K8s events of kafkatopic:

LAST SEEN   TYPE   REASON   OBJECT                         MESSAGE
39m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
55m         Info            kafkatopic/events-oxf          KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
93m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
95s         Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
31m         Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
69m         Info            kafkatopic/events-oxffe        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
7m36s       Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
67m         Info            kafkatopic/events-oxffe        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
61m         Info            kafkatopic/events-oxf          KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
95m         Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
71m         Info            kafkatopic/events-oxffe        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
59m         Info            kafkatopic/events-oxf          KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
95s         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
47m         Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
37m         Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
57m         Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
77m         Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
65m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
73m         Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
11m         Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
75m         Info            kafkatopic/events-info-oxf     KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
7m36s       Info            kafkatopic/events-oxffe        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
93m         Info            kafkatopic/events-oxf          KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
53m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
29m         Info            kafkatopic/events-info-oxf     KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
47m         Info            kafkatopic/events-info-oxf     KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
61m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
53m         Info            kafkatopic/events-info-oxf     KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
105m        Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
9m36s       Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
89m         Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
71m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
63m         Info            kafkatopic/events-info-oxf     KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
71m         Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
99m         Info            kafkatopic/events-oxf          KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
33m         Info            kafkatopic/events-oxf          KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
101m        Info            kafkatopic/events-oxfcs        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
21m         Info            kafkatopic/events-info-oxf     KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
85m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
79m         Info            kafkatopic/events-simux        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
25m         Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
37m         Info            kafkatopic/events-info-simux   KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.
63m         Info            kafkatopic/events-oxffe        KafkaTopic is incompatible with the topic metadata. The topic metadata will be treated as canonical.

Thank you.

[scholzj]

Nobody will be able to answer this with so little information. You need to provide the actual state of the resource and most likely also full Topic Operator logs.

[aamargant]

So on the picture I sent where all the topics are displayed some of them are ready = true but the other 3 dont have anything
Only the ones that are ready are being configured but im not sure how to check the logs/state of the other topics thata re not ready

[scholzj]

The picture just shows that they are not ready. But it does not say anything about any other conditions they might be in.

[scholzj]

So you need to get the YAMLs for them (kubectl get kt -o yaml)

[aamargant]

Ah okay thanks, I have updated the post with the yaml file

[aamargant]

well now I see that the topics that are not ready it says "message: 'Failure executing: GET at: https://10.224.0.1/apis/kafka.strimzi.io/v1beta2/namespaces/default/kafkatopics/events.simux. Message: kafkatopics.kafka.strimzi.io "events.simux" not found"

[scholzj]

@tombentley @tomncooper @LiamClarkeNZ Ever so something like this? Because I didn't 🤔

[LiamClarkeNZ]

Oh, and could you please also look at K8s events? There may be something useful in there.

kubectl get events --field-selector involvedObject.kind=KafkaTopic

Cheers.

[aamargant]

Hi @LiamClarkeNZ, so I have redeployed again and updated the post with the information you asked me although now it only configures the "pfxdata-mutation" topic and the other ones says the same error as you described before.

[LiamClarkeNZ]

Thanks @aamargant, can you please give me some more info?

1. Which version of Strimzi are you running?
2. What version of Kubernetes?

Also, just to confirm, how did you deploy the topic operator? Was it like this?

1. Topics already existed
2. KafkaTopic custom resources created
3. Topic Operator deployed

If you can give me a step by step it'll really help me to replicate the issue.

[aamargant]

Hi @LiamClarkeNZ, I use openshift version 4.8.29 that uses kubernetes 1.21 and deploy it with helm.
I found the problem and yes is what you stated, some pods were sending messages to the brokers and therefore kafka was creating the topics automatically on the brokers and then I would create the same topics but the metadata name of the topic was different. What I did finally was kafka to create the topics with 12 partitions and 540000ms retention time by default and removed the creation of the topics on my side, so after doing this the topics are created correctly. Thanks for the help!

[LiamClarkeNZ]

Ah, interesting, thanks @aamargant. So presumably the topic auto creation made them with the broker default number of partitions or replication factor, and your KafkaTopic was reducing the partition count compared to the default, or changing the replication factor.

The Topic Operator can't do either of those because you can't decrease partitions on a Kafka topic without deleting and recreating it, which needs to be done very carefully to avoid data loss, and changing RF requires telling Kafka where to put replicas.