Uploaded image for project: 'JBoss Enterprise Application Platform'
  1. JBoss Enterprise Application Platform
  2. JBEAP-3730

High response times in ejbremote REPL_SYNC load test

    XMLWordPrintable

Details

    Description

      Scenario: load-ejbremote-repl-sync
      Scenario description: 4-node EAP cluster, 5 nodes that generate stable load (4000 sessions in this scenario) for approx. 40 minutes. Delay between 2 subsequent invocations: 100 ms.

      Taken from EAP 7.0.0.ER6 performance.txt:

      Sessions: 4000 samples: 1109207, response mean: 331 ms, max: 17984 ms, sampling errors: 0, unhealthy samples: 133, valid samples: 1109074 (99%)
      Sessions: 4000 samples: 1087178, response mean: 340 ms, max: 17870 ms, sampling errors: 0, unhealthy samples: 130, valid samples: 1087048 (99%)
      Sessions: 4000 samples: 1088940, response mean: 339 ms, max: 13633 ms, sampling errors: 0, unhealthy samples: 124, valid samples: 1088816 (99%)
      

      There are ~1 000 000 requests (samples) made per each iteration (one iteration is represented with one line in performance.txt). Samples which arrive later than in 10 seconds are counted as "unhealthy samples". Each iteration, ~100 requests are marked as unhealthy (it takes 10-20 seconds to obtain the response). However, the mean response time is very good: ~350 ms.

      This did not happen in EAP 6.4.0.GA, where the max. response times reach ~2000 ms - performance.txt:

      Sessions: 4000 samples: 1252069, response mean: 278 ms, max: 1648 ms, sampling errors: 2, unhealthy samples: 0, valid samples: 1252067 (99%)
      Sessions: 4000 samples: 1268718, response mean: 275 ms, max: 1619 ms, sampling errors: 0, unhealthy samples: 0, valid samples: 1268718 (100%)
      Sessions: 4000 samples: 1279413, response mean: 271 ms, max: 2010 ms, sampling errors: 2, unhealthy samples: 0, valid samples: 1279411 (99%)
      

      Note:
      When async replication is used, max. response times reach up to 40 seconds, while mean response times are still good (~1700 ms) - performance.txt:

      Sessions: 4000 samples: 277397, response mean: 1631 ms, max: 41934 ms, sampling errors: 0, unhealthy samples: 1800, valid samples: 275597 (99%)
      Sessions: 4000 samples: 292370, response mean: 1539 ms, max: 35035 ms, sampling errors: 0, unhealthy samples: 2078, valid samples: 290292 (99%)
      Sessions: 4000 samples: 239075, response mean: 1889 ms, max: 30243 ms, sampling errors: 0, unhealthy samples: 2093, valid samples: 236982 (99%)
      

      Attachments

        Issue Links

          Activity

            People

              pferraro@redhat.com Paul Ferraro
              mvinkler1@redhat.com Michal Vinkler
              Daniel Cihak Daniel Cihak
              Daniel Cihak Daniel Cihak
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: