Uploaded image for project: 'AMQ Broker'
  1. AMQ Broker
  2. ENTMQBR-4157

Adding Wildcard Subscriptions Can Take Too Long, Resulting in Connections Closures Due to Exceeded KeepAlive

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical Critical
    • AMQ 7.8.0.CR3
    • AMQ 7.4.5.GA
    • None
    • None
    • False
    • False
    • ?
    • Undefined
    • Verified in a release
    • Hide

      TBD, but essentials are:

      • Deploy a broker cluster with load-balancing of ON_DEMAND
      • Deploy a number of topics
      • Create a very large number of wildcard subscriptions (on the order of 20k)
      • Under a load, detach and reattach subscriptions and watch for the client to report timeouts exceeded and close connections
      Show
      TBD, but essentials are: Deploy a broker cluster with load-balancing of ON_DEMAND Deploy a number of topics Create a very large number of wildcard subscriptions (on the order of 20k) Under a load, detach and reattach subscriptions and watch for the client to report timeouts exceeded and close connections

      When there are many wildcard (MQTT) subscriptions, searching for matching addresses in org.apache.activemq.artemis.core.postoffice.impl.WildcardAddressManager::.addAndUpdateAddressMap can take too long, causing the associated transport thread to miss heartbeats resulting in a closed connection. The method is synchronized, so having several threads queued on this method can easily result in timeouts. Is there a possibility of off-loading this processing to avoid blocking the connection thread and / or adding thread-safe concurrent access to the underlying map / data structures?

        1. 2.17.SNAPSHOT-tdumps.zip
          127 kB
        2. high-cpu-single.zip
          660 kB
        3. high-cpu-tdump.out
          1.73 MB
        4. high-cpu-tdump.out.zip
          103 kB
        5. high-cpu-tdumpSINGLEBROKER.out.zip
          500 kB
        6. threaded-consumer-1.0-SNAPSHOT-bin.zip
          7.03 MB
        7. threaded-mqtt-client.tar.gz
          10 kB
        8. threaded-producer-1.0-SNAPSHOT-bin.zip
          1.05 MB

            gtully@redhat.com Gary Tully
            rhn-support-dhawkins Duane Hawkins
            Tiago Bueno Tiago Bueno
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated:
              Resolved: