Uploaded image for project: 'AMQ Streams'
  1. AMQ Streams
  2. ENTMQST-2459

Kafka Exporter high CPU usage

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 1.8.0.GA
    • 1.6.0.GA
    • None
    • False
    • False
    • Undefined

      The KafkaExporter container consumes a significant amount of CPU on a cluster with thousands of topic/partitions.

      Having an unbounded parallelism in fetching the information about topics [0] does not scale well. Every goroutine is a thread and if you have lots of topics, this will result in lots of threads, all competing for CPU time.

      [0] https://github.com/danielqsj/kafka_exporter/blob/master/kafka_exporter.go#L369

              Unassigned Unassigned
              rhn-support-fvaleri Federico Valeri
              Lukas Kral Lukas Kral
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated:
                Resolved: