XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • None
    • 8.0.0.GA-CR2
    • Clustering, EJB, Undertow
    • None
    • False
    • None
    • False

      Scenario: we have a 4 nodes cluster where we deploy a clustered application ( clusterbench-ee10.ear ) containing some stateful EJB named RemoteStatefulSB:

      	java:global/clusterbench-ee10/clusterbench-ee10-ejb/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
      	java:app/clusterbench-ee10-ejb/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
      	java:module/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
      	java:jboss/exported/clusterbench-ee10/clusterbench-ee10-ejb/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB
      	ejb:clusterbench-ee10/clusterbench-ee10-ejb/RemoteStatefulSBImpl!org.jboss.test.clusterbench.ejb.stateful.RemoteStatefulSB?stateful
      	java:global/clusterbench-ee10/clusterbench-ee10-ejb/RemoteStatefulSBImpl
      	java:app/clusterbench-ee10-ejb/RemoteStatefulSBImpl
      	java:module/RemoteStatefulSBImpl
      

      We have a remote EJB client application performing remote invocations on the cluster nodes, using the emote+http protocol:

      remote+http://10.0.99.245:8080,remote+http://10.0.99.224:8080,remote+http://10.0.99.222:8080,remote+http://10.0.97.56:8080
      

      The client applications creates 4000 sessions; invocations are repeated every 4 seconds;

      Everything works fine if don't restart any node;

      As soon as we shut-down and restart EAP on the first node, EAP memory starts to grow:

      EAP memory continues to grow:

      until, eventually, the process is killed by the OS:

      $ sudo dmesg | tail -7
      [12671.708228] [   7229]   600  7229    88440      188   200704        0             0 gio
      [12671.709661] [   8476]   600  8476    55691      129    81920        0             0 standalone.sh
      [12671.711250] [   8627]   600  8627  1018253   723463  6549504        0             0 java
      [12671.712720] [   9163]     0  9163    54274       18    69632        0             0 sleep
      [12671.714234] [   9186]   600  9186    65958      141   155648        0             0 top
      [12671.715742] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-600.slice/session-4.scope,task=java,pid=8627,uid=600
      [12671.719219] Out of memory: Killed process 8627 (java) total-vm:4073012kB, anon-rss:2893852kB, file-rss:0kB, shmem-rss:0kB, UID:600 pgtables:6396kB oom_score_adj:0
      

        1. clusterbench-ee10.ear
          75 kB
        2. clustering-jmeter-samplers-jar-with-dependencies.jar
          19.45 MB
        3. jmap-8627-4234-1.png
          jmap-8627-4234-1.png
          205 kB
        4. jmap-8627-4314-1.png
          jmap-8627-4314-1.png
          206 kB
        5. jmap-8627-4354-1.png
          jmap-8627-4354-1.png
          209 kB
        6. jmap-8627-4435-1.png
          jmap-8627-4435-1.png
          195 kB
        7. logs.zip
          101 kB
        8. oom-after-node1-restart-1.png
          oom-after-node1-restart-1.png
          173 kB
        9. TestPlanEJB.jmx
          4 kB

            Unassigned Unassigned
            tborgato@redhat.com Tommaso Borgato
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: