Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-5139

Kafka: SSL handshake failed : unexpected eof while reading Error in Vector Collector

XMLWordPrintable

    • False
    • None
    • False
    • NEW
    • NEW
    • Hide
      Before this update, the TLS section was added without checking broker URL schema, this is caused SSL connection errors if the URLs didn't start with 'tls'. With this change, the TLS section is only added if brokers URLs start with 'tls', it will prevent SSL connection errors.
      Show
      Before this update, the TLS section was added without checking broker URL schema, this is caused SSL connection errors if the URLs didn't start with 'tls'. With this change, the TLS section is only added if brokers URLs start with 'tls', it will prevent SSL connection errors.
    • Log Collection - Sprint 250, Log Collection - Sprint 251, Log Collection - Sprint 252, Log Collection - Sprint 253, Log Collection - Sprint 257, Log Collection - Sprint 258

      Description of problem:

      -Kafka: SSL handshake failed : unexpected eof while reading Error in Vector Collector.
      -Logforwarding to kafka destination is not working with Vector Collector.

      Version-Release number of selected component (if applicable):

      How reproducible:

      It can be reproduced:

      Steps to Reproduce:

      1. Install RHOCP Cluster . (4.12, 4.13, 4.14)
      2. Install Cluster Logging Operator 5.8.3
      3. Create a ClusterLogging instance using Vector as collector.
      4. Create a secret and a CLF instance with Kafka brokers:
      apiVersion: logging.openshift.io/v1
      kind: ClusterLogForwarder
      metadata:
        name: instance
        namespace: openshift-logging
      spec:
        outputs:
          - name: kafka
            type: "kafka"
            secret:
              name: kafka-secret
            kafka:
              brokers:
                - tcp://XXXXX1:9093
                - tcp://XXXXX2:9093
                - tcp://XXXXX3:9093
              topic: XXXX-demo
        pipelines:
          - name: XXXX-demo
            inputRefs:
              - XXXX-demo
            outputRefs:
              - kafka
      

            5. Check the logs of collector pods:

      2024-02-17T10:02:51.987537Z ERROR librdkafka: librdkafka: FAIL [thrd:sasl_ssl://KAFKA_BROKER_IP:9093/bootstrap]: sasl_ssl://KAFKA_BROKER_IP:9093/bootstrap: SSL handshake failed: error:0A000126:SSL routines::unexpected eof while reading (after 100ms in state SSL_HANDSHAKE, 13 identical error(s) suppressed)    
      2024-02-17T10:02:51.987595Z ERROR rdkafka::client: librdkafka: Global error: SSL (Local: SSL error): sasl_ssl://KAFKA_BROKER_IP:9093/bootstrap: SSL handshake failed: error:0A000126:SSL routines::unexpected eof while reading (after 100ms in state SSL_HANDSHAKE, 13 identical error(s) suppressed) 
      

      Actual results:

      Collector pods are streaming above error logs.
      Logs are not getting forwarded to Kafka destination.
      Tried with a single kafka broker as well, but received same error logs.

      Expected results:

      ClusterLogFowarder needs to forward logs to Kafka destination.

      Additional info:

      • Same configuration is working fine with Fluentd as collector.
      • Facing issue while using Vector as collector.
      • Tried with a single kafka broker as well, but received same error logs.

            vparfono Vitalii Parfonov
            rhn-support-pripatil Prithviraj Patil
            Anping Li Anping Li
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: