Uploaded image for project: 'WildFly'
  1. WildFly
  2. WFLY-19752

OOME during scaledown of node in Artemis/Messaging cluster

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Critical Critical
    • None
    • 33.0.2.Final
    • JMS
    • None
    • Hide

      Steps to reproduce:

      • Start two servers with attached standalone-full-ha.xml profile so they form a cluster
        • sh standalone.sh -c standalone-full-ha.xml
        • sh standalone.sh -c standalone-full-ha.xml -Djboss.socket.binding.port-offset=1000
      • Send 100 000 messages into 1st server into the InQueue
        • Download attached client-1.0-SNAPSHOT.jar:
        • java -cp ./client-1.0-SNAPSHOT.jar:$JBOSS_HOME/bin/client/jboss-client.jar org.jboss.jms.client.ProducerTransAck
      • Gracefully shutdown the 1st server
      • Wait for OOME to occur
      Show
      Steps to reproduce: Start two servers with attached standalone-full-ha.xml profile so they form a cluster sh standalone.sh -c standalone-full-ha.xml sh standalone.sh -c standalone-full-ha.xml -Djboss.socket.binding.port-offset=1000 Send 100 000 messages into 1st server into the InQueue Download attached client-1.0-SNAPSHOT.jar: java -cp ./client-1.0-SNAPSHOT.jar:$JBOSS_HOME/bin/client/jboss-client.jar org.jboss.jms.client.ProducerTransAck Gracefully shutdown the 1st server Wait for OOME to occur
    • ---
    • ---

      There is OOME when scaling down the node in messaging cluster. It seems to be trying to send all messages in a single transaction:
      https://github.com/apache/activemq-artemis/blob/main/artemis-server/src/main/java/org/apache/activemq/artemis/core/server/impl/ScaleDownHandler.java#L262-L319

      causing OOME.

        1. client-1.0-SNAPSHOT.jar
          56 kB
        2. scaledown-oome.png
          scaledown-oome.png
          213 kB
        3. server1-log.zip
          15.50 MB
        4. standalone-full-ha.xml
          38 kB

              ehugonne1@redhat.com Emmanuel Hugonnet
              mnovak1@redhat.com Miroslav Novak
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: