Uploaded image for project: 'AMQ Streams'
  1. AMQ Streams
  2. ENTMQST-2459

Kafka Exporter high CPU usage

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Done
    • 1.6.0.GA
    • 1.8.0.GA
    • None

    Description

      The KafkaExporter container consumes a significant amount of CPU on a cluster with thousands of topic/partitions.

      Having an unbounded parallelism in fetching the information about topics [0] does not scale well. Every goroutine is a thread and if you have lots of topics, this will result in lots of threads, all competing for CPU time.

      [0] https://github.com/danielqsj/kafka_exporter/blob/master/kafka_exporter.go#L369

      Attachments

        Activity

          People

            Unassigned Unassigned
            rhn-support-fvaleri Federico Valeri
            Lukas Kral Lukas Kral
            Votes:
            1 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: