SSL failures during connection attempts to Kafka brokers

[vparfonov]

Hello,
I'm seeking help with unclear behavior with Kafka sink. I have got SSL error during establish connection with Kafka broker. Trying with different Vector versions, both fail but with different errors.

Environments:

1. Vector Version: 0.28.1
   Error Message:

ERROR librdkafka: librdkafka: FAIL [thrd:sasl_ssl://KAFKA_BROKER_IP:9093/bootstrap]: sasl_ssl://KAFKA_BROKER_IP:9093/bootstrap: SSL handshake failed: error:0A000126:SSL routines::unexpected eof while reading (after 100ms in state SSL_HANDSHAKE, 13 identical error(s) suppressed)
ERROR rdkafka::client: librdkafka: Global error: SSL (Local: SSL error): sasl_ssl://KAFKA_BROKER_IP:9093/bootstrap: SSL handshake failed: error:0A000126:SSL routines::unexpected eof while reading (after 100ms in state SSL_HANDSHAKE, 13 identical error(s) suppressed)

2. Vector Version: 0.34.1
   Error Message:

ERROR rdkafka::client: librdkafka: Global error: BrokerTransportFailure (Local: Broker transport failure): sasl_ssl://KAFKA_BROKER_IP:443/bootstrap: Disconnected (after 76074ms in state UP)

Similarity:

• Both environments are running Red Hat Enterprise Linux 9.3.
• Both errors involve SSL failures during connection attempts to Kafka brokers.
• OpenSSL version: 3.0.7 (in both environments)

While the root cause appears to be the same, Vector handles the issue differently based on the version.

Error 1: Unexpected EOF during SSL handshake.
Error 2: Broker transport failure after connection established

I came across this GitHub issue #openssl/issues/18866#issuecomment-1194219601 that mentions potential compatibility issues with certain configurations and OpenSSL 3.x. Could this be relevant to my situation? More generally, might the OpenSSL version be contributing to these errors?

I would greatly appreciate any insights or suggestions you might have to help me troubleshoot and resolve these issues. Additionally, please let me know if you require further information such as specific Kafka versions or Vector configurations.

Thank you for your time and assistance.