"/bin/sh: unzip: command not found" when tying to build a Kafka Connector. #7952

jvieten · 2023-01-20T20:03:59Z

jvieten
Jan 20, 2023

With the latest https://strimzi.io/install/latest?namespace=kafka
if I deploy

`
apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnect
build:
output:
type: docker
image: test:test
pushSecret: regcred1

plugins:
  - name: kafka-connect-jdbc
    artifacts:
      - type: zip
        url: https://d1i4a15mxbxib1.cloudfront.net/api/plugins/confluentinc/kafka-connect-jdbc/versions/10.6.3/confluentinc-kafka-connect-jdbc-10.6.3.zip

`
error log

/bin/sh: unzip: command not found
error building image: error building stage: failed to execute command: waiting for process to exit: exit status 127

Is this a bug?

scholzj · 2023-01-20T21:47:17Z

scholzj
Jan 20, 2023
Maintainer

That seems strange. It works fine for me:

  status:
    conditions:
    - lastTransitionTime: "2023-01-20T21:42:04.794804401Z"
      status: "True"
      type: Ready
    connectorPlugins:
    # ...
    - class: io.confluent.connect.jdbc.JdbcSourceConnector
      type: source
      version: 10.6.3

Maybe you can share the full log & config?

0 replies

jvieten · 2023-01-21T09:08:05Z

jvieten
Jan 21, 2023
Author

I am on ClusterOperator 0.32.0

Here is the KafkaConnect yaml:
Just because this discussion is public I replaced the real url's with dummy urls
eu.gcr.io/test/test:test and : localhost:8777

apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnect
metadata:
  name: kafka-connect-jdbc
  annotations:
    strimzi.io/use-connector-resources: "true"
spec:
  version: 3.3.1
  replicas: 1
  image: eu.gcr.io/test/test:test
  bootstrapServers: localhost:8777

  authentication:
    type: plain
    username: "xxxxxx"
    passwordSecret:
      secretName: my-secret
      password: pass

  tls:
    trustedCertificates: []

  config:
    group.id: kafka-connect-jdbc-k8s
    config.storage.replication.factor: -1
    offset.storage.replication.factor: -1
    status.storage.replication.factor: -1
    offset.storage.topic: connect-jdbc-offsets
    config.storage.topic: connect-jdbc-configs
    status.storage.topic: connect-jdbc-status
    key.converter: org.apache.kafka.connect.storage.StringConverter
    value.converter: org.apache.kafka.connect.json.JsonConverter
    internal.key.converter: org.apache.kafka.connect.storage.StringConverter
    internal.value.converter: org.apache.kafka.connect.json.JsonConverter
    key.converter.schemas.enable: false
    value.converter.schemas.enable: false
    plugin.path: "/usr/share/java,/usr/share/confluent-hub-components"

  build:
    output:
      type: docker
      image: eu.gcr.io/test/test:test
      pushSecret: regcred1
    plugins:
      - name: kafka-connect-jdbc
        artifacts:
          - type: zip
            url: https://d1i4a15mxbxib1.cloudfront.net/api/plugins/confluentinc/kafka-connect-jdbc/versions/10.6.3/confluentinc-kafka-connect-jdbc-10.6.3.zip

  resources:
    requests:
      cpu: "1"
      memory: 2Gi
    limits:
      cpu: "2"
      memory: 2Gi
  logging:
    type: inline
    loggers:
      log4j.rootLogger: "TRACE"
  readinessProbe:
    initialDelaySeconds: 30
    timeoutSeconds: 5
  livenessProbe:
    initialDelaySeconds: 30
    timeoutSeconds: 5apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnect
metadata:
  name: kafka-connect-jdbc
  annotations:
    strimzi.io/use-connector-resources: "true"
spec:
  version: 3.3.1
  replicas: 1
  image: eu.gcr.io/test/test:test
  bootstrapServers: localhost:8777

  authentication:
    type: plain
    username: "xxxxxx"
    passwordSecret:
      secretName: my-secret
      password: pass

  tls:
    trustedCertificates: []

  config:
    group.id: kafka-connect-jdbc-k8s
    config.storage.replication.factor: -1
    offset.storage.replication.factor: -1
    status.storage.replication.factor: -1
    offset.storage.topic: connect-jdbc-offsets
    config.storage.topic: connect-jdbc-configs
    status.storage.topic: connect-jdbc-status
    key.converter: org.apache.kafka.connect.storage.StringConverter
    value.converter: org.apache.kafka.connect.json.JsonConverter
    internal.key.converter: org.apache.kafka.connect.storage.StringConverter
    internal.value.converter: org.apache.kafka.connect.json.JsonConverter
    key.converter.schemas.enable: false
    value.converter.schemas.enable: false
    plugin.path: "/usr/share/java,/usr/share/confluent-hub-components"

  build:
    output:
      type: docker
      image: eu.gcr.io/test/test:test
      pushSecret: regcred1
    plugins:
      - name: kafka-connect-jdbc
        artifacts:
          - type: zip
            url: https://d1i4a15mxbxib1.cloudfront.net/api/plugins/confluentinc/kafka-connect-jdbc/versions/10.6.3/confluentinc-kafka-connect-jdbc-10.6.3.zip

  resources:
    requests:
      cpu: "1"
      memory: 2Gi
    limits:
      cpu: "2"
      memory: 2Gi
  logging:
    type: inline
    loggers:
      log4j.rootLogger: "TRACE"
  readinessProbe:
    initialDelaySeconds: 30
    timeoutSeconds: 5
  livenessProbe:
    initialDelaySeconds: 30
    timeoutSeconds: 5

and here is the

INFO[0000] Retrieving image manifest eu.gcr.io/test/test:test 
INFO[0000] Retrieving image eu.gcr.io/test/test:test from registry eu.gcr.io 
INFO[0001] Built cross stage deps: map[]                
INFO[0001] Retrieving image manifest eu.gcr.io/test/test:test
INFO[0001] Returning cached image manifest              
INFO[0001] Executing 0 build triggers                   
INFO[0001] Building stage 'eu.gcr.io/test/test:test' [idx: '0', base-idx: '-1'] 
INFO[0001] Unpacking rootfs as cmd RUN 'mkdir' '-p' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'curl' '-f' '-L' '--output' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' 'https://d1i4a15mxbxib1.cloudfront.net/api/plugins/confluentinc/kafka-connect-jdbc/versions/10.6.3/confluentinc-kafka-connect-jdbc-10.6.3.zip'       && 'unzip' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' '-d' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'find' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609' '-type' 'l' | 'xargs' 'rm' '-f'       && 'rm' '-vf' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' requires it. 
INFO[0028] USER root:root                               
INFO[0028] Cmd: USER                                    
INFO[0028] RUN 'mkdir' '-p' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'curl' '-f' '-L' '--output' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' 'https://d1i4a15mxbxib1.cloudfront.net/api/plugins/confluentinc/kafka-connect-jdbc/versions/10.6.3/confluentinc-kafka-connect-jdbc-10.6.3.zip'       && 'unzip' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' '-d' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'find' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609' '-type' 'l' | 'xargs' 'rm' '-f'       && 'rm' '-vf' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' 
INFO[0028] Initializing snapshotter ...                 
INFO[0028] Taking snapshot of full filesystem...        
INFO[0028] Cmd: /bin/sh                                 
INFO[0028] Args: [-c 'mkdir' '-p' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'curl' '-f' '-L' '--output' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' 'https://d1i4a15mxbxib1.cloudfront.net/api/plugins/confluentinc/kafka-connect-jdbc/versions/10.6.3/confluentinc-kafka-connect-jdbc-10.6.3.zip'       && 'unzip' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' '-d' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'find' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609' '-type' 'l' | 'xargs' 'rm' '-f'       && 'rm' '-vf' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip'] 
INFO[0028] Util.Lookup returned: &{Uid:0 Gid:0 Username:root Name: HomeDir:/root} 
INFO[0028] Performing slow lookup of group ids for root 
INFO[0028] Running: [/bin/sh -c 'mkdir' '-p' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'curl' '-f' '-L' '--output' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' 'https://d1i4a15mxbxib1.cloudfront.net/api/plugins/confluentinc/kafka-connect-jdbc/versions/10.6.3/confluentinc-kafka-connect-jdbc-10.6.3.zip'       && 'unzip' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip' '-d' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609'       && 'find' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609' '-type' 'l' | 'xargs' 'rm' '-f'       && 'rm' '-vf' '/opt/kafka/plugins/kafka-connect-jdbc/3bb40609.zip'] 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 19.2M  100 19.2M    0     0  3441k      0  0:00:05  0:00:05 --:--:-- 4058k
/bin/sh: unzip: command not found
error building image: error building stage: failed to execute command: waiting for process to exit: exit status 127

Do you see something wrong with my config? Since I am new to strimzi do you see something odd with my config?
Many Greetings!

2 replies

jvieten Jan 21, 2023
Author

I did the following to get a step further:
I deleted the image line in the spec section

spec:
  version: 3.3.1
  replicas: 1
  bootstrapServers: localhost:8777

This caused the image to at least be build and pushed. But the process then simply stopped.
Maybe I am doing something completely wrong here?

scholzj Jan 21, 2023
Maintainer

I deleted the image line in the spec section

Yeah ... so, the .spec.image is the base image that will be used to build the new image with the additional container. You can use the image field to specify a custom image. But the custom image still needs to be based on the regular Strimzi image from the same version of Strimzi you are using. I obviously don't see what the container image you used there looks like, but it is likely:

Not based on the Strimzi Kafka container image
Based on the Strimzi Kafka container image, but from a wrong Strimzi version which did not container unzip

As you seem to be using Strimzi 0.32.0 with Kafka 3.3.1 -> so normally quay.io/strimzi/kafka:0.32.0-kafka-3.3.1 should be the right base image you should use.

This caused the image to at least be build and pushed. But the process then simply stopped.

After the build is done, a new Deployment with your Connect cluster should be created. If it wasn't, you should check (and possibly share):

The Strimzi cluster operator logs
Check your Kubernetes cluster if the Deployment / Pods exist, have any events etc.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Strimzi

"/bin/sh: unzip: command not found" when tying to build a Kafka Connector. #7952

Uh oh!

{{title}}

Uh oh!

Replies: 2 comments 2 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Strimzi

"/bin/sh: unzip: command not found" when tying to build a Kafka Connector. #7952

Uh oh!

jvieten Jan 20, 2023

Replies: 2 comments · 2 replies

Uh oh!

scholzj Jan 20, 2023 Maintainer

Uh oh!

jvieten Jan 21, 2023 Author

Uh oh!

jvieten Jan 21, 2023 Author

Uh oh!

scholzj Jan 21, 2023 Maintainer

jvieten
Jan 20, 2023

Replies: 2 comments 2 replies

scholzj
Jan 20, 2023
Maintainer

jvieten
Jan 21, 2023
Author

jvieten Jan 21, 2023
Author

scholzj Jan 21, 2023
Maintainer