Uploaded image for project: 'AMQ Broker'
  1. AMQ Broker
  2. ENTMQBR-8261

[Docs] Queue federation - pull messages on demand in batches, tracking local queue backlog

XMLWordPrintable

      federation makes use of priority adjustment, however with large back logs or low credit or slow consumption, low priority federation consumers (which are fast) will get to consume, which can lead to lots of unnecessary message migration.

      throttling via a rate limit help mitigate, but reduces throughput when there is no local demand. (https://issues.redhat.com/browse/ENTMQBR-7385)

      With this enhancement, a federation consumer will only attempt to pull a batch of messages when there are no local messages (queue size == 0). Priority can still be in play, the consumer will toggle its credit request.

      in the case where only producers are upstream, local consumer will get to consume batches of messages.

      there is no mass migration and consequently no need to mass migrate back.

      the presence of the consumer is demand, the absence of local messages is the trigger to open that demand channel.

       

        1. image-2023-09-21-12-41-28-503.png
          121 kB
          John Clifford
        2. image-2023-09-21-12-55-24-553.png
          103 kB
          John Clifford
        3. image-2023-09-21-13-10-28-450.png
          102 kB
          John Clifford
        4. image-2023-09-21-15-30-23-145.png
          125 kB
          John Clifford
        5. image-2023-10-04-15-47-41-691.png
          132 kB
          John Clifford

              jcliffor@redhat.com John Clifford
              gtully@redhat.com Gary Tully
              Roman Vais Roman Vais (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: