Uploaded image for project: 'WildFly'
  1. WildFly
  2. WFLY-18309

Clustering: Time out waiting for responses during re-balance

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 30.0.0.Final
    • 30.0.0.Beta1
    • Clustering
    • None

      In a four nodes cluster, we trigger fail-over by shutting down and restarting nodes one by one in a sequence;

      Node 4 emits this error when node 2 leaves the cluster and it has completed rebalance with nodes 3,4,1 (node 2 is not restarted yet) (complete logs in wildfly-logs.zip ):

      2023-07-30 08:42:58,579 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (timeout-thread--p13-t1) ISPN000136: Error executing command GetKeyValueCommand on Cache 'clusterbench-ee10.ear', writing keys []: org.infinispan.util.concurrent.TimeoutException: ISPN000476: Timed out waiting for responses for request 36058 from wildfly1 after 10 seconds
      	at org.infinispan@14.0.13.Final//org.infinispan.remoting.transport.impl.MultiTargetRequest.onTimeout(MultiTargetRequest.java:171)
      	at org.infinispan@14.0.13.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:88)
      	at org.infinispan@14.0.13.Final//org.infinispan.remoting.transport.AbstractRequest.call(AbstractRequest.java:22)
      	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at java.base/java.lang.Thread.run(Thread.java:834)
      

            pferraro@redhat.com Paul Ferraro
            tborgato@redhat.com Tommaso Borgato
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: