Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-5112

BrokerTransportFailure Error for Kafka brokers when using Vector as collector

XMLWordPrintable

    • False
    • None
    • False
    • NEW
    • NEW
    • Bug Fix
    • Log Collection - Sprint 257, Log Collection - Sprint 258
    • Moderate

      Description of problem:

      While using vector as collector, Kafka brokers get disconnected with the below error message.

      ERROR rdkafka::client: librdkafka: Global error: BrokerTransportFailure (Local: Broker transport failure): XXXXXXXX:9093/bootstrap: Disconnected: verify that security.protocol is correctly configured, broker might require SASL authentication (after 108ms in state UP, 4 identical error(s) suppressed)

      The configuration of Kafka in ClusterLogForwarder work seamlessly with Fluentd as the collector, When we switch the collector type vector , we encounter the same issue.

      outputs:
  - kafka:
      brokers:
      - tcp://xxxxxxxxx:9093
      - tcp://xxxxxxxxx:9093
      - tcp://xxxxxxxxx:9093
    name: kafka-broker-infra
    secret:
      name: kafak-secret
    type: kafka

      We attempted to specify a single broker, but encountered the same error message.

      spec:
  outputs:
  - name: kafka-cluster1
     secret:
       name: kafka-secret
    type: kafka
    url: tcp://xxxxxx

      Version-Release number of selected component (if applicable):

      cluster-logging.v5.8.1

      Must-gather

            vparfono Vitalii Parfonov
            rhn-support-kirpatil Kiran Patil
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: