test connector not working #5769

Fattouh92 · 2021-10-25T10:33:44Z

Fattouh92
Oct 25, 2021

with the following yamls

apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnect
metadata:
  name: default-connect-cluster
  namespace: kafka-demos
  annotations:
    strimzi.io/use-connector-resources: "true"
spec:
  version: 2.8.1
  replicas: 1
  bootstrapServers: my-cluster-kafka-bootstrap:9092
  config:
    group.id: default-connect-cluster
    offset.storage.topic: default-connect-cluster-offsets
    config.storage.topic: default-connect-cluster-configs
    status.storage.topic: default-connect-cluster-status
    # -1 means it will use the default replication factor configured in the broker
    config.storage.replication.factor: 1
    offset.storage.replication.factor: 1
    status.storage.replication.factor: 1

and

apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnector
metadata:
  name: default-source-connector
  namespace: kafka-demos
  labels:
    strimzi.io/cluster: default-connect-cluster
spec:
  class: org.apache.kafka.connect.file.FileStreamSourceConnector
  tasksMax: 1
  config:
    file: "/opt/kafka/LICENSE"
    topic: my-topic

the connect operator is started and healthy but the connector is not created and I get the error GET /connectors/default-source-connector/config returned 500 (Internal Server Error): Request timed out in the strimzi operator pod

Answered by Fattouh92

Oct 29, 2021

so weirdly, this resolved itself and I have no idea what was the change which is not a very comfortable feeling

View full answer

scholzj · 2021-10-25T14:46:10Z

scholzj
Oct 25, 2021
Maintainer

I guess you would need to share some logs? Probably both from the operator and from Connect. Also, make sure that if you run multiple Connect clusters you need to use unique group ID and topic names for each Connect.

5 replies

Fattouh92 Oct 26, 2021
Author

@scholzj thanks for your reply

same problem with MM2 connector and similar log output which probably boils downs to the same reason

Failed to reconcile
io.strimzi.operator.cluster.operator.assembly.ConnectRestException: GET /connectors/source-cluster->target-cluster.MirrorHeartbeatConnector/config returned 500 (Internal Server Error): Request timed out
	at io.strimzi.operator.cluster.operator.assembly.KafkaConnectApiImpl.lambda$doGet$6(KafkaConnectApiImpl.java:143) ~[io.strimzi.cluster-operator-0.26.0.jar:0.26.0]
	at io.vertx.core.impl.future.FutureImpl$1.onSuccess(FutureImpl.java:91) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.future.FutureBase.lambda$emitSuccess$0(FutureBase.java:54) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.EventLoopContext.execute(EventLoopContext.java:81) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.ContextImpl.execute(ContextImpl.java:260) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.EventLoopContext.execute(EventLoopContext.java:22) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.future.FutureBase.emitSuccess(FutureBase.java:51) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.future.FutureImpl.tryComplete(FutureImpl.java:211) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.future.PromiseImpl.tryComplete(PromiseImpl.java:23) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.http.impl.HttpEventHandler.handleEnd(HttpEventHandler.java:79) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.http.impl.HttpClientResponseImpl.handleEnd(HttpClientResponseImpl.java:250) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.http.impl.Http1xClientConnection$StreamImpl.lambda$new$0(Http1xClientConnection.java:377) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.streams.impl.InboundBuffer.handleEvent(InboundBuffer.java:240) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.streams.impl.InboundBuffer.write(InboundBuffer.java:130) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.http.impl.Http1xClientConnection$StreamImpl.handleEnd(Http1xClientConnection.java:592) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.EventLoopContext.execute(EventLoopContext.java:71) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.impl.ContextImpl.execute(ContextImpl.java:267) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.http.impl.Http1xClientConnection.handleResponseEnd(Http1xClientConnection.java:826) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.http.impl.Http1xClientConnection.handleHttpMessage(Http1xClientConnection.java:698) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.http.impl.Http1xClientConnection.handleMessage(Http1xClientConnection.java:662) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.net.impl.ConnectionBase.read(ConnectionBase.java:155) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.vertx.core.net.impl.VertxHandler.channelRead(VertxHandler.java:154) ~[io.vertx.vertx-core-4.1.5.jar:4.1.5]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) ~[io.netty.netty-codec-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) ~[io.netty.netty-codec-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:280) ~[io.netty.netty-handler-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581) ~[io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [io.netty.netty-transport-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) [io.netty.netty-common-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [io.netty.netty-common-4.1.68.Final.jar:4.1.68.Final]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty.netty-common-4.1.68.Final.jar:4.1.68.Final]
	at java.lang.Thread.run(Thread.java:829) [?:?]

Fattouh92 Oct 26, 2021
Author

also attaching the logs for the connector in question

Error reconciling connector default-source-connector
io.strimzi.operator.cluster.operator.assembly.ConnectRestException: GET /connectors/default-source-connector/config returned 500 (Internal Server Error): Request timed out
	at io.strimzi.operator.cluster.operator.assembly.KafkaConnectApiImpl.lambda$doGet$6(KafkaConnectApiImpl.java:143) ~[io.strimzi.cluster-operator-0.25.0.jar:0.25.0]
	at io.vertx.core.impl.future.FutureImpl$1.onSuccess(FutureImpl.java:90) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.future.FutureBase.lambda$emitSuccess$0(FutureBase.java:54) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.EventLoopContext.execute(EventLoopContext.java:80) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.ContextImpl.execute(ContextImpl.java:261) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.EventLoopContext.execute(EventLoopContext.java:22) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.future.FutureBase.emitSuccess(FutureBase.java:51) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.future.FutureImpl.tryComplete(FutureImpl.java:179) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.future.PromiseImpl.tryComplete(PromiseImpl.java:23) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.http.impl.HttpEventHandler.handleEnd(HttpEventHandler.java:79) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.http.impl.HttpClientResponseImpl.handleEnd(HttpClientResponseImpl.java:250) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.http.impl.Http1xClientConnection$StreamImpl.lambda$new$0(Http1xClientConnection.java:372) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.streams.impl.InboundBuffer.handleEvent(InboundBuffer.java:240) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.streams.impl.InboundBuffer.write(InboundBuffer.java:130) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.http.impl.Http1xClientConnection$StreamImpl.handleEnd(Http1xClientConnection.java:587) ~[io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.EventLoopContext.execute(EventLoopContext.java:70) [io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.impl.ContextImpl.execute(ContextImpl.java:268) [io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.http.impl.Http1xClientConnection.handleResponseEnd(Http1xClientConnection.java:811) [io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.http.impl.Http1xClientConnection.handleHttpMessage(Http1xClientConnection.java:685) [io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.http.impl.Http1xClientConnection.handleMessage(Http1xClientConnection.java:649) [io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.net.impl.ConnectionBase.read(ConnectionBase.java:155) [io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.vertx.core.net.impl.VertxHandler.channelRead(VertxHandler.java:154) [io.vertx.vertx-core-4.1.2.jar:4.1.2]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) [io.netty.netty-codec-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) [io.netty.netty-codec-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:280) [io.netty.netty-handler-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:719) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:655) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:581) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [io.netty.netty-transport-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986) [io.netty.netty-common-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [io.netty.netty-common-4.1.66.Final.jar:4.1.66.Final]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty.netty-common-4.1.66.Final.jar:4.1.66.Final]
	at java.lang.Thread.run(Thread.java:829) [?:?]

Fattouh92 Oct 26, 2021
Author

I tried with both strimzi 0.25 and 0.26

scholzj Oct 26, 2021
Maintainer

I'm afraid that is not a log. That is just a single exception which might be sometimes helpful, but in many cases it means nothing on its own.

Fattouh92 Oct 26, 2021
Author

which logs then are you referring to? the surrounding logs in the operator do not say much as well. Do I have to enable a more verbose level -DEBUG- or something?

Fattouh92 · 2021-10-29T13:16:19Z

Fattouh92
Oct 29, 2021
Author

so weirdly, this resolved itself and I have no idea what was the change which is not a very comfortable feeling

1 reply

scholzj Oct 29, 2021
Maintainer

Well, you never provided the logs, so hard to say what was the issue.

Strimzi

test connector not working #5769

Uh oh!

Fattouh92 Oct 25, 2021

Replies: 2 comments · 6 replies

Uh oh!

scholzj Oct 25, 2021 Maintainer

Uh oh!

Uh oh!

Fattouh92 Oct 26, 2021 Author

Uh oh!

Fattouh92 Oct 26, 2021 Author

Uh oh!

Fattouh92 Oct 26, 2021 Author

Uh oh!

scholzj Oct 26, 2021 Maintainer

Uh oh!

Uh oh!

Fattouh92 Oct 26, 2021 Author

Uh oh!

Fattouh92 Oct 29, 2021 Author

Uh oh!

scholzj Oct 29, 2021 Maintainer

Fattouh92
Oct 25, 2021

Replies: 2 comments 6 replies

scholzj
Oct 25, 2021
Maintainer

Fattouh92 Oct 26, 2021
Author

Fattouh92 Oct 26, 2021
Author

Fattouh92 Oct 26, 2021
Author

scholzj Oct 26, 2021
Maintainer

Fattouh92 Oct 26, 2021
Author

Fattouh92
Oct 29, 2021
Author

scholzj Oct 29, 2021
Maintainer