Uploaded image for project: 'AMQ Broker'
  1. AMQ Broker
  2. ENTMQBR-9624

OOME during scaledown of node in Artemis/Messaging cluster

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • None
    • None
    • None
    • 1
    • False
    • Hide

      None

      Show
      None
    • False
    • Hide

      Steps to reproduce:

      • Start two servers with attached standalone-full-ha.xml profile so they form a cluster
        • sh standalone.sh -c standalone-full-ha.xml
        • sh standalone.sh -c standalone-full-ha.xml -Djboss.socket.binding.port-offset=1000
      • Send 100 000 messages into 1st server into the InQueue
        • Download attached client-1.0-SNAPSHOT.jar:
        • java -cp ./client-1.0-SNAPSHOT.jar:$JBOSS_HOME/bin/client/jboss-client.jar org.jboss.jms.client.ProducerTransAck
      • Gracefully shutdown the 1st server
      • Wait for OOME to occur
      Show
      Steps to reproduce: Start two servers with attached standalone-full-ha.xml profile so they form a cluster sh standalone.sh -c standalone-full-ha.xml sh standalone.sh -c standalone-full-ha.xml -Djboss.socket.binding.port-offset=1000 Send 100 000 messages into 1st server into the InQueue Download attached client-1.0-SNAPSHOT.jar: java -cp ./client-1.0-SNAPSHOT.jar:$JBOSS_HOME/bin/client/jboss-client.jar org.jboss.jms.client.ProducerTransAck Gracefully shutdown the 1st server Wait for OOME to occur

      There is OOME when scaling down the node in messaging cluster. It seems to be trying to send all messages in a single transaction:
      https://github.com/apache/activemq-artemis/blob/main/artemis-server/src/main/java/org/apache/activemq/artemis/core/server/impl/ScaleDownHandler.java#L262-L319

      causing OOME.

        1. client-1.0-SNAPSHOT.jar
          56 kB
        2. scaledown-oome.png
          scaledown-oome.png
          213 kB
        3. server1-log.zip
          15.50 MB
        4. standalone-full-ha.xml
          38 kB

              rhn-support-jbertram Justin Bertram
              mnovak1@redhat.com Miroslav Novak
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: