Uploaded image for project: 'Managed Service - Streams'
  1. Managed Service - Streams
  2. MGDSTRM-9590

Config the num.recovery.threads.per.data.dir value to kafka instance

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • kasFleetShard-0.30.0
    • None
    • None
    • None
    • MK - Sprint 226

      WHAT

      Since we've decided and tested the num.recovery.threads.per.data.dir value in MGDSTRM-9019, we should set the value to kafka instance.

      WHY

      To improve the return to service time following abnormal broker shutdown

       

      HOW

      It is best if systems adapt to their environment, rather than exposing another knob for a human to turn/forget to turn.

      Can we make use of cpu fleetshard passes to the broker container with appropriate max/min clamps so it can sensibly adapt to different cpu resource limits?

      I note that this config is per data dir, so for future proofing, I suggest putting the number of data dirs into the equation too..

      DONE

      Set the value in fleetshard. 

            lukchen@redhat.com Luke Chen
            lukchen@redhat.com Luke Chen
            Kafka Integrations
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: