Uploaded image for project: 'JBoss Enterprise Application Platform'
  1. JBoss Enterprise Application Platform
  2. JBEAP-25853

[CLUSTERING] undeploy intermittently causes WARN and ERRORS with shared sessions

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • 8.0.0.GA-CR1
    • Clustering
    • False
    • None
    • False
    • Known Issue

      Scenario: we have a 4 nodes cluster configured with a replicated cache for web and ejb:

      embed-server --server-config=standalone-ha.xml
      if (outcome != success) of /subsystem=jgroups:read-attribute(name=default-stack)
      /subsystem=jgroups/channel=ee:write-attribute(name=stack,value=tcp)
      else
      /subsystem=jgroups:write-attribute(name=default-stack,value=tcp)
      /subsystem=jgroups/channel=ee:write-attribute(name=stack,value=tcp)
      end-if
      batch
      /subsystem=infinispan/cache-container=web/distributed-cache=dist:remove
      /subsystem=infinispan/cache-container=ejb/distributed-cache=dist:remove
      # web cache
      /subsystem=infinispan/cache-container=web/replicated-cache=dist:add()
      /subsystem=infinispan/cache-container=web/replicated-cache=dist/component=locking:add(isolation=REPEATABLE_READ)
      /subsystem=infinispan/cache-container=web/replicated-cache=dist/component=transaction:add(mode=BATCH)
      /subsystem=infinispan/cache-container=web/replicated-cache=dist/store=file:add(purge=true, passivation=true)
      /subsystem=infinispan/cache-container=web:write-attribute(name=default-cache, value=dist)
      # ejb cache
      /subsystem=infinispan/cache-container=ejb/replicated-cache=dist:add()
      /subsystem=infinispan/cache-container=ejb/replicated-cache=dist/component=locking:add(isolation=REPEATABLE_READ)
      /subsystem=infinispan/cache-container=ejb/replicated-cache=dist/component=transaction:add(mode=BATCH)
      /subsystem=infinispan/cache-container=ejb/replicated-cache=dist/store=file:add(purge=true, passivation=true)
      /subsystem=infinispan/cache-container=ejb:write-attribute(name=default-cache, value=dist)
      

      We deploy clusterbench-ee10-shared-sessions.ear on each node: this application is configured to share sessions between the war files it contains: the jboss-all.xml file in the EAR file is configured as follows:

      <?xml version="1.0" encoding="UTF-8"?>
      <jboss umlns="urn:jboss:1.0">
          <shared-session-config xmlns="urn:jboss:shared-session-config:1.0">
              <!--<distributable/>-->
              <session-config>
                  <cookie-config>
                      <path>/</path>
                  </cookie-config>
              </session-config>
          </shared-session-config>
      </jboss>
      

      This is the sequence of events that leads to errors:

      1. node1 is started and clusterbench-ee10-shared-sessions.ear is deployed on it
      2. node2 is started and clusterbench-ee10-shared-sessions.ear is deployed on it
      3. node3 is started and clusterbench-ee10-shared-sessions.ear is deployed on it
      4. node4 is started and clusterbench-ee10-shared-sessions.ear is deployed on it
      5. clusterbench-ee10-shared-sessions.ear is un-deployed from node1

      After the application is un-deployed we observe a long list of warnings emitted by node1:

      2023-10-07 10:08:29,702 WARN  [org.infinispan.transaction.impl.TransactionTable] (thread-43,ejb,wildfly1) ISPN000102: Unable to roll back global transaction GlobalTransaction{id=7944, addr=wildfly3, remote=false, xid=null, internalId=-1}: org.infinispan.commons.IllegalLifecycleStateException: Cannot wire or start components while the registry is not running
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl.prepareWrapperChange(BasicComponentRegistryImpl.java:690)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl.wireWrapper(BasicComponentRegistryImpl.java:206)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl$ComponentWrapper.wire(BasicComponentRegistryImpl.java:829)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl$ComponentWrapper.running(BasicComponentRegistryImpl.java:805)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl$ComponentWrapper.running(BasicComponentRegistryImpl.java:811)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.commands.tx.RollbackCommand.invokeAsync(RollbackCommand.java:39)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.transaction.impl.TransactionTable.killTransactionAsync(TransactionTable.java:614)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.transaction.impl.TransactionTable.killAllTransactionsAsync(TransactionTable.java:523)
      	at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:714)
      	at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
      	at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.AbstractRequest.complete(AbstractRequest.java:68)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.SingleTargetRequest.onResponse(SingleTargetRequest.java:47)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.RequestRepository.addResponse(RequestRepository.java:51)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport.processResponse(JGroupsTransport.java:1578)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport.processMessage(JGroupsTransport.java:1480)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport$ChannelCallbacks.up(JGroupsTransport.java:1685)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.JChannel.up(JChannel.java:733)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.fork.ForkProtocolStack.up(ForkProtocolStack.java:131)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.stack.Protocol.up(Protocol.java:314)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FORK.up(FORK.java:145)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FRAG2.up(FRAG2.java:139)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FlowControl.up(FlowControl.java:245)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FlowControl.up(FlowControl.java:245)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.GMS.up(GMS.java:845)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:226)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.deliverMessage(UNICAST3.java:1083)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.addMessage(UNICAST3.java:822)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.handleDataReceived(UNICAST3.java:804)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.up(UNICAST3.java:453)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:679)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.VERIFY_SUSPECT2.up(VERIFY_SUSPECT2.java:105)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FailureDetection.up(FailureDetection.java:180)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FD_SOCK2.up(FD_SOCK2.java:188)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.MERGE3.up(MERGE3.java:274)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.Discovery.up(Discovery.java:294)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.stack.Protocol.up(Protocol.java:314)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.TP.passMessageUp(TP.java:1183)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.util.SubmitToThreadPool$SingleMessageHandler.run(SubmitToThreadPool.java:107)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at org.wildfly.clustering.context@8.0.0.GA-redhat-00009//org.wildfly.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
      	at org.wildfly.clustering.context@8.0.0.GA-redhat-00009//org.wildfly.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:78)
      	at java.base/java.lang.Thread.run(Thread.java:834)
      

      as the test proceeds, the application is re-deployed to node1 and undeployed from node2 and node2 starts to log the same warnings:

      2023-10-07 10:11:43,059 WARN  [org.infinispan.transaction.impl.TransactionTable] (thread-44,ejb,wildfly2) ISPN000102: Unable to roll back global transaction GlobalTransaction{id=39298, addr=wildfly4, remote=false, xid=null, internalId=-1}: org.infinispan.commons.IllegalLifecycleStateException: Cannot wire or start components while the registry is not running
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl.prepareWrapperChange(BasicComponentRegistryImpl.java:690)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl.wireWrapper(BasicComponentRegistryImpl.java:206)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl$ComponentWrapper.wire(BasicComponentRegistryImpl.java:829)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl$ComponentWrapper.running(BasicComponentRegistryImpl.java:805)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.factories.impl.BasicComponentRegistryImpl$ComponentWrapper.running(BasicComponentRegistryImpl.java:811)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.commands.tx.RollbackCommand.invokeAsync(RollbackCommand.java:39)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.transaction.impl.TransactionTable.killTransactionAsync(TransactionTable.java:614)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.transaction.impl.TransactionTable.killAllTransactionsAsync(TransactionTable.java:523)
      	at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:714)
      	at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
      	at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.AbstractRequest.complete(AbstractRequest.java:68)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.SingleTargetRequest.onResponse(SingleTargetRequest.java:47)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.RequestRepository.addResponse(RequestRepository.java:51)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport.processResponse(JGroupsTransport.java:1578)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport.processMessage(JGroupsTransport.java:1480)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport$ChannelCallbacks.up(JGroupsTransport.java:1685)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.JChannel.up(JChannel.java:733)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.fork.ForkProtocolStack.up(ForkProtocolStack.java:131)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.stack.Protocol.up(Protocol.java:314)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FORK.up(FORK.java:145)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FRAG2.up(FRAG2.java:139)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FlowControl.up(FlowControl.java:245)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FlowControl.up(FlowControl.java:245)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.GMS.up(GMS.java:845)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:226)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.deliverMessage(UNICAST3.java:1083)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.addMessage(UNICAST3.java:822)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.handleDataReceived(UNICAST3.java:804)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.up(UNICAST3.java:453)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:679)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.VERIFY_SUSPECT2.up(VERIFY_SUSPECT2.java:105)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FailureDetection.up(FailureDetection.java:180)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FD_SOCK2.up(FD_SOCK2.java:188)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.MERGE3.up(MERGE3.java:274)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.Discovery.up(Discovery.java:294)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.stack.Protocol.up(Protocol.java:314)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.TP.passMessageUp(TP.java:1183)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.util.SubmitToThreadPool$SingleMessageHandler.run(SubmitToThreadPool.java:107)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at org.wildfly.clustering.context@8.0.0.GA-redhat-00009//org.wildfly.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
      	at org.wildfly.clustering.context@8.0.0.GA-redhat-00009//org.wildfly.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:78)
      	at java.base/java.lang.Thread.run(Thread.java:834)
      

      even when the application is redeployed on node2, the warning continues and, eventually, is replaced by the following error:

      2023-10-07 10:18:29,476 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (thread-79,ejb,wildfly2) ISPN000136: Error executing command GetKeyValueCommand on Cache 'clusterbench-ee10.ear', writing keys []: org.infinispan.remoting.RemoteException: ISPN000217: Received exception from wildfly4, see cause for remote stack trace
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.ResponseCollectors.wrapRemoteException(ResponseCollectors.java:25)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.MapResponseCollector.addException(MapResponseCollector.java:65)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.MapResponseCollector$IgnoreLeavers.addException(MapResponseCollector.java:103)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.ValidResponseCollector.addResponse(ValidResponseCollector.java:29)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.MultiTargetRequest.onResponse(MultiTargetRequest.java:93)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.impl.RequestRepository.addResponse(RequestRepository.java:51)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport.processResponse(JGroupsTransport.java:1578)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport.processMessage(JGroupsTransport.java:1480)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport$ChannelCallbacks.up(JGroupsTransport.java:1685)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.JChannel.up(JChannel.java:733)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.fork.ForkProtocolStack.up(ForkProtocolStack.java:131)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.stack.Protocol.up(Protocol.java:314)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FORK.up(FORK.java:145)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FRAG2.up(FRAG2.java:139)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FlowControl.up(FlowControl.java:245)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FlowControl.up(FlowControl.java:245)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.GMS.up(GMS.java:845)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:226)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.deliverMessage(UNICAST3.java:1083)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.addMessage(UNICAST3.java:822)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.handleDataReceived(UNICAST3.java:804)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.UNICAST3.up(UNICAST3.java:453)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:679)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.VERIFY_SUSPECT2.up(VERIFY_SUSPECT2.java:105)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FailureDetection.up(FailureDetection.java:180)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.FD_SOCK2.up(FD_SOCK2.java:188)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.MERGE3.up(MERGE3.java:274)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.Discovery.up(Discovery.java:294)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.stack.Protocol.up(Protocol.java:314)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.protocols.TP.passMessageUp(TP.java:1183)
      	at org.jgroups@5.2.14.Final-redhat-00001//org.jgroups.util.SubmitToThreadPool$SingleMessageHandler.run(SubmitToThreadPool.java:107)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at org.wildfly.clustering.context@8.0.0.GA-redhat-00009//org.wildfly.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
      	at org.wildfly.clustering.context@8.0.0.GA-redhat-00009//org.wildfly.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:78)
      	at java.base/java.lang.Thread.run(Thread.java:834)
      Caused by: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 15 seconds for key SessionCreationMetaDataKey(p8KLL1z0_nTe7RABSZdK2B_khlpF-b9MxUMpCCtP) and requestor GlobalTransaction{id=70165, addr=wildfly2, remote=true, xid=null, internalId=-1}. Lock is held by GlobalTransaction{id=69473, addr=wildfly2, remote=true, xid=null, internalId=-1} (pending)
      	at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      	at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      	at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.exts.ThrowableExternalizer.newThrowableInstance(ThrowableExternalizer.java:287)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.exts.ThrowableExternalizer.readGenericThrowable(ThrowableExternalizer.java:265)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.exts.ThrowableExternalizer.readObject(ThrowableExternalizer.java:240)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.exts.ThrowableExternalizer.readObject(ThrowableExternalizer.java:44)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.readWithExternalizer(GlobalMarshaller.java:727)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.readNonNullableObject(GlobalMarshaller.java:708)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.readNullableObject(GlobalMarshaller.java:357)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.BytesObjectInput.readObject(BytesObjectInput.java:32)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.responses.ExceptionResponse$Externalizer.readObject(ExceptionResponse.java:49)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.responses.ExceptionResponse$Externalizer.readObject(ExceptionResponse.java:41)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.readWithExternalizer(GlobalMarshaller.java:727)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.readNonNullableObject(GlobalMarshaller.java:708)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.readNullableObject(GlobalMarshaller.java:357)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.objectFromObjectInput(GlobalMarshaller.java:191)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.marshall.core.GlobalMarshaller.objectFromByteBuffer(GlobalMarshaller.java:220)
      	at org.infinispan@14.0.11.Final-redhat-00001//org.infinispan.remoting.transport.jgroups.JGroupsTransport.processResponse(JGroupsTransport.java:1570)
      	... 29 more
      

      more exceptions follow on all nodes... find the complete logs files attached ( wildfly-shared-sessions.zip );

      The issue is intermittent (it popped out in 2 runs on a total 7 runs) and the overall client fail rate is still low;

            Unassigned Unassigned
            tborgato@redhat.com Tommaso Borgato
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: