Uploaded image for project: 'WildFly'
  1. WildFly
  2. WFLY-10391

ArrayIndexOutOfBoundsException on server using scattered cache

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • 13.0.0.Final
    • 13.0.0.Beta1
    • Clustering
    • None

    Description

      We hit ArrayIndexOutOfBoundsException when running tests for RFE EAP7-867.

      EAP distribution was built from https://github.com/pferraro/wildfly/tree/scattered .
      Test description: Positive stress test (no failover), 4-node EAP cluster, clients: starting with 400 clients in the beginning, raising the number of clients to 6000 in the end of the test.

      Error occured on server dev215 around 7th iteration (can be seen in the performance report, link below):

      [JBossINF] [0m[31m04:26:11,708 ERROR [stderr] (transport-thread--p15-t25) Exception in thread "transport-thread--p15-t25" java.lang.ArrayIndexOutOfBoundsException: 129
[JBossINF] [0m[31m04:26:11,708 ERROR [stderr] (transport-thread--p15-t25) 	at org.infinispan.scattered.impl.ScatteredVersionManagerImpl.lambda$tryRegularInvalidations$4(ScatteredVersionManagerImpl.java:413)
[JBossINF] [0m[31m04:26:11,708 ERROR [stderr] (transport-thread--p15-t25) 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[JBossINF] [0m[31m04:26:11,708 ERROR [stderr] (transport-thread--p15-t25) 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[JBossINF] [0m[31m04:26:11,708 ERROR [stderr] (transport-thread--p15-t25) 	at org.wildfly.clustering.service.concurrent.ClassLoaderThreadFactory.lambda$newThread$0(ClassLoaderThreadFactory.java:47)
[JBossINF] [0m[31m04:26:11,708 ERROR [stderr] (transport-thread--p15-t25) 	at java.lang.Thread.run(Thread.java:748)

      Clients were getting "SocketTimeoutException: Read timed out" exceptions even before the ArrayIndexOutOfBoundsException ocurred, but also after.

      Performance report (accessible only when connected to VPN):
      http://download.eng.brq.redhat.com/scratch/mvinkler/reports/2018-04-19_15-10-14/stress.html

      One can observe that dev215 CPU usage and network usage dropped after 7th iteration.

      dev215 server log link:
      https://jenkins.hosts.mwqe.eng.bos.redhat.com/hudson/job/eap-7x-stress-session-scattered-sync/13/console-dev215/

      Attachments

        Issue Links

          is cloned by

          Bug - A problem that impairs or prevents the functions of the product. ISPN-9094 ArrayIndexOutOfBoundsException on server using scattered cache

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed
          is incorporated by

          Component Upgrade - A task tracking an update to a bundled component or revision of component upstream of the project. WFLY-10461 Upgrade Infinispan to 9.2.4.Final

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Activity

            People

              rhn-engineering-rhusar Radoslav Husar
              mvinkler1@redhat.com Michal Vinkler
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: