11:35:49,734 DEBUG [org.infinispan.commons.test.TestNGTestListener] (testng) After setup testClassStarted 11:35:49,734 DEBUG [org.infinispan.commons.test.TestNGTestListener] (testng) Before setup createBeforeClass 11:35:49,734 DEBUG [org.infinispan.commons.test.TestNGTestListener] (testng) After setup createBeforeClass 11:35:49,734 DEBUG [org.infinispan.commons.test.TestNGTestListener] (testng) Before setup createBeforeMethod 11:35:49,734 DEBUG [org.infinispan.distribution.rehash. (testng) Creating cache managers 11:35:49,735 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: ModuleLifecycle 11:35:49,736 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: CoreTestMetadataFileFinder 11:35:49,738 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: TestModuleCommandExtensions 11:35:49,739 DEBUG [org.infinispan.util.ModuleProperties] (testng) Loading module command extension SPI class: org.infinispan.remoting.rpc.TestModuleCommandExtensions@3ec2f327 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute runningCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute nodeAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute physicalAddresses [r=true,w=false,is=false,type=java.lang.String] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterSize [r=true,w=false,is=false,type=int] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute globalConfigurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheConfigurationNames [r=true,w=false,is=false,type=java.lang.String] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheNames [r=true,w=false,is=false,type=java.lang.String] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterName [r=true,w=false,is=false,type=java.lang.String] 11:35:49,739 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterMembers [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinator [r=true,w=false,is=true,type=boolean] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinatorAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute name [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute createdCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheManagerStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String pushState 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String bringSiteOnline 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String cancelPushState 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String takeSiteOffline 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterAvailability [r=true,w=false,is=false,type=java.lang.String] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,740 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:49,740 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3f3bfcff under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=CacheManager,name="DefaultCacheManager",component=CacheManager 11:35:49,740 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@41ab3a68 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=CacheManager,name="DefaultCacheManager",component=GlobalXSiteAdminOperations 11:35:49,740 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3900d505 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=CacheManager,name="DefaultCacheManager",component=LocalTopologyManager 11:35:49,740 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@442fb007 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=CacheManager,name="DefaultCacheManager",component=CacheContainerStats 11:35:49,745 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000078: Starting JGroups channel ISPN 11:35:49,749 DEBUG [org.jgroups.stack.Configurator] (testng) set property TCP_NIO2.diagnostics_addr to default value /224.0.75.75 11:35:49,750 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:49,750 TRACE [org.jgroups.protocols.UNICAST3] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:49,750 TRACE [org.jgroups.blocks.MessageDispatcher] (testng) setting local_addr (null) to NodeA-45995 11:35:49,750 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeA-45995: stable task started 11:35:49,750 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Discovery.stopped=false 11:35:49,751 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) address=NodeA-45995, cluster=ISPN, physical address=127.0.0.1:8300 11:35:49,751 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Added discovery for NodeA-45995. Registered discoveries: {NodeA-45995=TEST_PING@NodeA-45995} 11:35:49,755 DEBUG [org.infinispan.test.fwk.TEST_PING] (testng) No other nodes yet, marking this node as coord 11:35:49,755 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeA-45995: no members discovered after 4 ms: creating cluster as first member 11:35:49,755 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (testng) [NodeA-45995 setDigest()] new digest: NodeA-45995: [0 (0)] resulting digest: NodeA-45995: [0 (0)] 11:35:49,755 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeA-45995: installing view [NodeA-45995|0] (1) [NodeA-45995] 11:35:49,755 DEBUG [org.jgroups.protocols.pbcast.STABLE] (testng) resuming message garbage collection 11:35:49,755 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeA-45995: reset digest to NodeA-45995: [-1] 11:35:49,755 TRACE [org.jgroups.protocols.tom.TOA] (testng) Handle view [NodeA-45995|0] (1) [NodeA-45995] 11:35:49,755 TRACE [org.jgroups.protocols.MFC] (testng) new membership: [NodeA-45995] 11:35:49,758 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (testng) Added a new task directly: 0 task(s) are waiting 11:35:49,759 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) New view accepted: [NodeA-45995|0] (1) [NodeA-45995] 11:35:49,759 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|0] (1) [NodeA-45995] 11:35:49,760 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeA-45995: reset digest to NodeA-45995: [-1] 11:35:49,760 DEBUG [org.jgroups.protocols.pbcast.STABLE] (testng) resuming message garbage collection 11:35:49,760 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeA-45995: created cluster (first member). My view is [NodeA-45995|0], impl is org.jgroups.protocols.pbcast.CoordGmsImpl 11:35:49,760 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000079: Channel ISPN local address is NodeA-45995, physical addresses are [127.0.0.1:8300] 11:35:49,760 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Starting LocalTopologyManager on NodeA-45995 11:35:49,760 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Received new cluster view: 0, isCoordinator = true, old status = INITIALIZING 11:35:49,760 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Recovering cluster status for view 0 11:35:49,760 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) dests=null, command=CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0}, mode=SYNCHRONOUS, timeout=24000 11:35:49,765 DEBUG [org.infinispan.manager.DefaultCacheManager] (testng) Started cache manager ISPN on NodeA 11:35:49,766 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) About to wire and start cache dist 11:35:49,766 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:49,767 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) Waiting on view 0 being accepted 11:35:49,767 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Sending cluster status response for view 0 11:35:49,767 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Got 1 status responses. members are [NodeA-45995] 11:35:49,767 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Updating cluster members for all the caches. New list is [NodeA-45995] 11:35:49,767 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 11:35:49,767 INFO [org.infinispan.transaction.lookup.JBossStandaloneJTAManagerLookup] (testng) ISPN000107: Retrieving transaction manager Transaction: unknown 11:35:49,771 TRACE [org.infinispan.factories.InterceptorChainFactory] (testng) Finished building default interceptor chain. 11:35:49,776 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: FilterIndexingServiceProvider 11:35:49,776 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain size: 14 11:35:49,776 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain is: 11:35:49,777 TRACE [org.infinispan.transaction.xa.TransactionFactory] (testng) Setting factory enum to NODLD_NORECOVERY_NOXA 11:35:49,778 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 11:35:49,778 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:49,779 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:49,779 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isLocatedLocally 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.util.List locateKey 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isAffectedByRehash 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:49,780 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rollbacks [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute commits [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute prepares [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute storeWrites [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute invalidations [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStaleStatsTreshold 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictionSize [r=true,w=true,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute elapsedTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void recordKnownGlobalKeyset 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void disconnectSource 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationFailures [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationCount [r=true,w=false,is=false,type=long] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStatisticsEnabled 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@21b529cc under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=LockManager 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@51112194 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3dd83554 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@6c027afe under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Passivation 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@6471c5fb under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Transactions 11:35:49,781 DEBUG [org.infinispan.jmx.JmxUtil] (testng) Object name infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3c344560 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@403ab527 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Configuration 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3f90f254 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Activation 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@55a4a640 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Statistics 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@4ba5e6d1 under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 11:35:49,781 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@5e23e10f under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RpcManager 11:35:49,782 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@6619aacd under infinispan-d01742c1-64a6-418e-9376-a657d380df2e:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 11:35:49,782 TRACE [org.infinispan.jmx.CacheJmxRegistration] (testng) ISPN000031: MBeans were successfully registered to the platform MBean server. 11:35:49,782 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (testng) starting distribution manager on NodeA-45995 11:35:49,782 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Starting StateTransferManager of cache dist on node NodeA-45995 11:35:49,782 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Node NodeA-45995 joining cache dist 11:35:49,785 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeA-45995, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:49,787 TRACE [org.infinispan.topology.ClusterCacheStatus] (testng) Cache dist initialized. Persisted state? false 11:35:49,788 TRACE [org.infinispan.topology.ClusterCacheStatus] (testng) Added joiner NodeA-45995 to cache dist with persistent uuid 7b0eab6e-85dc-4af1-b423-5186b3cfc4d8: members = [NodeA-45995], joiners = [NodeA-45995] 11:35:49,788 TRACE [org.infinispan.topology.ClusterCacheStatus] (testng) Initializing status for cache dist 11:35:49,791 TRACE [org.infinispan.topology.ClusterCacheStatus] (testng) Cache dist topology updated: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]}, members = [NodeA-45995], joiners = [] 11:35:49,792 TRACE [org.infinispan.topology.CacheTopology] (testng) Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 11:35:49,798 TRACE [org.infinispan.topology.ClusterCacheStatus] (testng) Cache dist stable topology updated: members = [NodeA-45995], joiners = [], topology = CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:49,798 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (testng) Updating cluster-wide stable topology for cache dist, topology = CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:49,798 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995], throwable=null, viewId=0} 11:35:49,798 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=null, command=CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995], throwable=null, viewId=0}, mode=ASYNCHRONOUS, timeout=240000 11:35:49,800 DEBUG [org.infinispan.topology.ClusterCacheStatus] (testng) Queueing rebalance for cache dist with members [NodeA-45995] 11:35:49,800 TRACE [org.infinispan.topology.ClusterCacheStatus] (testng) Rebalancing consistent hash for cache dist, members are [NodeA-45995] 11:35:49,800 TRACE [org.infinispan.topology.ClusterCacheStatus] (testng) The balanced CH is the same as the current CH, not rebalancing 11:35:49,800 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) Waiting on view 0 being accepted 11:35:49,800 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating local topology for cache dist: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:49,800 TRACE [org.infinispan.topology.CacheTopology] (testng) Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 11:35:49,800 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Installing new cache topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} on cache dist 11:35:49,800 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) This is the first topology 1 in which the local node is a member 11:35:49,800 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:49,800 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling topology 1 is installed 11:35:49,802 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Unable to acquire cluster listeners from other members, assuming none are present 11:35:49,802 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) On cache dist we have: added segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:49,802 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (testng) Adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist 11:35:49,802 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Finished adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist 11:35:49,802 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 11:35:49,802 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling transaction data received for topology 1 11:35:49,802 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Checking for transactions originated on leavers. Current cache members are [NodeA-45995], remote transactions: 0 11:35:49,802 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) No remote transactions pertain to originator(s) who have left the cluster. 11:35:49,804 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (testng) Removing no longer owned entries for cache dist 11:35:49,804 DEBUG [org.infinispan.transaction.impl.TransactionTable] (testng) Topology changed, recalculating minTopologyId 11:35:49,804 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Changing minimum topology ID from -1 to 1 11:35:49,804 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Initial state transfer complete for cache dist on node NodeA-45995 11:35:49,804 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating stable topology for cache dist: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:49,804 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) StateTransferManager of cache dist on node NodeA-45995 received initial topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:49,804 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:49,808 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Waiting for initial state transfer to finish for cache dist on NodeA-45995 11:35:49,808 DEBUG [org.infinispan.cache.impl.CacheImpl] (testng) Started cache dist on NodeA-45995 11:35:49,808 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Closing latch for cache dist 11:35:49,809 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: ModuleLifecycle 11:35:49,810 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: CoreTestMetadataFileFinder 11:35:49,813 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: TestModuleCommandExtensions 11:35:49,813 DEBUG [org.infinispan.util.ModuleProperties] (testng) Loading module command extension SPI class: org.infinispan.remoting.rpc.TestModuleCommandExtensions@2b7fa93 11:35:49,813 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String takeSiteOffline 11:35:49,813 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String pushState 11:35:49,813 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String bringSiteOnline 11:35:49,813 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String cancelPushState 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterAvailability [r=true,w=false,is=false,type=java.lang.String] 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheConfigurationNames [r=true,w=false,is=false,type=java.lang.String] 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinatorAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterMembers [r=true,w=false,is=false,type=java.lang.String] 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinator [r=true,w=false,is=true,type=boolean] 11:35:49,814 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute physicalAddresses [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheManagerStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute nodeAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute name [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute createdCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheNames [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute runningCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterSize [r=true,w=false,is=false,type=int] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterName [r=true,w=false,is=false,type=java.lang.String] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute globalConfigurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:49,815 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:49,816 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:49,816 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:49,816 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:49,818 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:49,822 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:49,837 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:49,841 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:49,841 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:49,841 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:49,841 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@73ed8452 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=CacheManager,name="DefaultCacheManager",component=GlobalXSiteAdminOperations 11:35:49,841 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@42a9b71b under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=CacheManager,name="DefaultCacheManager",component=LocalTopologyManager 11:35:49,841 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@2323cc6a under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=CacheManager,name="DefaultCacheManager",component=CacheManager 11:35:49,841 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@6049ec0d under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=CacheManager,name="DefaultCacheManager",component=CacheContainerStats 11:35:49,843 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000078: Starting JGroups channel ISPN 11:35:49,846 DEBUG [org.jgroups.stack.Configurator] (testng) set property TCP_NIO2.diagnostics_addr to default value /224.0.75.75 11:35:49,847 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:49,847 TRACE [org.jgroups.protocols.UNICAST3] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:49,847 TRACE [org.jgroups.blocks.MessageDispatcher] (testng) setting local_addr (null) to NodeB-51742 11:35:49,847 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeB-51742: stable task started 11:35:49,847 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Discovery.stopped=false 11:35:49,852 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) address=NodeB-51742, cluster=ISPN, physical address=127.0.0.1:8301 11:35:49,852 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Added discovery for NodeB-51742. Registered discoveries: {NodeA-45995=TEST_PING@NodeA-45995, NodeB-51742=TEST_PING@NodeB-51742} 11:35:49,864 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeA-45995 with physical address 127.0.0.1:8300 in TEST_PING@NodeB-51742 11:35:49,879 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeB-51742 with physical address 127.0.0.1:8301 in TEST_PING@NodeA-45995 11:35:49,903 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Returning ping rsp: NodeA-45995, name=NodeA-45995, addr=127.0.0.1:8300, coord 11:35:49,903 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Skipping sending discovery to self 11:35:49,911 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeB-51742: discovery took 58 ms, members: 1 rsps (1 coords) [done] 11:35:49,920 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeB-51742: sending JOIN(NodeB-51742) to NodeA-45995 11:35:49,932 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742: created sender window for NodeA-45995 (conn-id=0) 11:35:49,932 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #1, conn_id=0, first) 11:35:49,932 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are GMS: GmsHeader[JOIN_REQ]: mbr=NodeB-51742, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:49,932 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:49,932 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (86 bytes) 11:35:49,938 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) 127.0.0.1:8301: connecting to 127.0.0.1:8300 11:35:49,963 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_REQ]: mbr=NodeB-51742, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:49,969 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #1, conn_id=0, first) 11:35:49,969 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: created receiver window for NodeB-51742 at seqno=#1 for conn-id=0 11:35:49,969 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#1 11:35:49,976 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: joiners=[NodeB-51742], suspected=[], leaving=[], new view: [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:49,979 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) suspending message garbage collection 11:35:49,979 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) NodeA-45995: resume task started, max_suspend_time=33000 11:35:49,979 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: mcasting view [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] (2 mbrs) 11:35:49,990 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (ViewHandler,NodeA-45995) NodeA-45995: sending NodeA-45995#1 11:35:49,994 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to null, src=NodeA-45995, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 11:35:49,994 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: looping back message [dst: , src: NodeA-45995 (3 headers), size=57 bytes] 11:35:49,994 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: received [dst: , src: NodeA-45995 (3 headers), size=57 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 11:35:49,994 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: received NodeA-45995#1 11:35:49,994 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: delivering NodeA-45995#1-1 (1 messages) 11:35:49,994 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (108 bytes (540.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:49,994 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: received full view: [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:49,997 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: installing view [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:49,994 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (111 bytes) 11:35:50,007 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1] 11:35:50,007 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeA-45995) Handle view [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:50,007 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeA-45995) new membership: [NodeA-45995, NodeB-51742] 11:35:50,008 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=57 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 11:35:50,008 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: message NodeA-45995::1 was added to queue (not yet server) 11:35:50,014 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,015 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) New view accepted: [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:50,018 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) Joined: [NodeB-51742], Left: [] 11:35:50,019 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:50,019 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeA-45995) ISPN100000: Node NodeB-51742 joined the cluster 11:35:50,019 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742], oldMembers=[NodeA-45995], localAddress=NodeA-45995, viewId=1, subgroupsMerged=null, mergeView=false} and result was 281479271677952 11:35:50,019 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t5) Received new cluster view: 1, isCoordinator = true, old status = COORDINATOR 11:35:50,019 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t5) Updating cluster members for all the caches. New list is [NodeA-45995, NodeB-51742] 11:35:50,019 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t5) dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 11:35:50,019 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:50,019 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,019 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t5) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient NodeB-51742 with response mode GET_ALL 11:35:50,019 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742], oldMembers=[NodeA-45995], localAddress=NodeA-45995, viewId=1, subgroupsMerged=null, mergeView=false} and result was 281479271677952 11:35:50,025 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995: created sender window for NodeA-45995 (conn-id=0) 11:35:50,025 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995 --> DATA(NodeA-45995: #1, conn_id=0, first) 11:35:50,025 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: sending msg to NodeA-45995, src=NodeA-45995, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:50,022 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t5) NodeA-45995: invoking unicast RPC [req-id=449] on NodeB-51742 11:35:50,033 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t5) NodeA-45995: created sender window for NodeB-51742 (conn-id=1) 11:35:50,046 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t5) NodeA-45995 --> DATA(NodeB-51742: #1, conn_id=1, first) 11:35:50,046 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t5) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=449, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:50,046 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,046 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (84 bytes) 11:35:50,030 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: looping back message [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 11:35:50,046 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=449, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:50,046 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #1, conn_id=1, first) 11:35:50,046 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: created receiver window for NodeA-45995 at seqno=#1 for conn-id=1 11:35:50,046 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#1 11:35:50,046 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 449 11:35:50,050 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:50,050 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- DATA(NodeA-45995: #1, conn_id=0, first) 11:35:50,050 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:50,053 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:50,059 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995: delivering NodeA-45995#1 11:35:50,070 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (1) from members for view [NodeA-45995|1] 11:35:50,070 TRACE [org.jgroups.protocols.UNICAST3] (ViewHandler,NodeA-45995) NodeA-45995 --> DATA(NodeB-51742: #2, conn_id=1) 11:35:50,072 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,074 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (132 bytes (660.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,074 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (135 bytes) 11:35:50,080 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=61 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,080 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #2, conn_id=1) 11:35:50,080 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#2 11:35:50,083 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (testng) [NodeB-51742 setDigest()] new digest: NodeA-45995: [0 (0)], NodeB-51742: [0 (0)] resulting digest: NodeA-45995: [0 (0)], NodeB-51742: [0 (0)] 11:35:50,083 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeB-51742: installing view [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:50,083 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeB-51742: reset digest to NodeA-45995: [-1], NodeB-51742: [-1] 11:35:50,083 TRACE [org.jgroups.protocols.tom.TOA] (testng) Handle view [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:50,083 TRACE [org.jgroups.protocols.MFC] (testng) new membership: [NodeA-45995, NodeB-51742] 11:35:50,083 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (testng) Added a new task directly: 0 task(s) are waiting 11:35:50,083 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) New view accepted: [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:50,083 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|1] (2) [NodeA-45995, NodeB-51742] 11:35:50,084 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (testng) NodeB-51742: flushing become_server_queue (1 elements) 11:35:50,084 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #2, conn_id=0) 11:35:50,084 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: received NodeA-45995#1 11:35:50,084 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:50,084 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#1-1 (1 messages) 11:35:50,084 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000079: Channel ISPN local address is NodeB-51742, physical addresses are [127.0.0.1:8301] 11:35:50,084 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,084 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (70 bytes) 11:35:50,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeB-51742, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=24000 11:35:50,084 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeB-51742, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient NodeA-45995 with response mode GET_ALL 11:35:50,084 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeB-p417-t1) Received new cluster view: 1, isCoordinator = false, old status = INITIALIZING 11:35:50,084 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeB-51742: invoking unicast RPC [req-id=455] on NodeA-45995 11:35:50,084 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #3, conn_id=0) 11:35:50,084 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=455, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:50,084 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,084 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (84 bytes) 11:35:50,087 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:50,087 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #2, conn_id=0) 11:35:50,087 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#2 11:35:50,087 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (1) from joiners for view [NodeA-45995|1] 11:35:50,087 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=455, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:50,087 TRACE [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1] 11:35:50,087 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #3, conn_id=0) 11:35:50,087 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) resuming message garbage collection 11:35:50,087 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#3 11:35:50,087 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 455 11:35:50,090 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeB-51742] 11:35:50,102 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t3) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:50,099 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,110 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t3) sending rsp for 455 to NodeB-51742 11:35:50,113 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t3) NodeA-45995 --> DATA(NodeB-51742: #3, conn_id=1) 11:35:50,113 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t3) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=455, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,113 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,113 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (81 bytes) 11:35:50,113 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=455, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,115 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #3, conn_id=1) 11:35:50,115 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#3 11:35:50,115 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:50,116 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Starting LocalTopologyManager on NodeB-51742 11:35:50,116 DEBUG [org.infinispan.manager.DefaultCacheManager] (testng) Started cache manager ISPN on NodeB 11:35:50,116 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t1) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:50,116 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) About to wire and start cache dist 11:35:50,121 INFO [org.infinispan.transaction.lookup.JBossStandaloneJTAManagerLookup] (testng) ISPN000107: Retrieving transaction manager Transaction: unknown 11:35:50,130 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t1) sending rsp for 449 to NodeA-45995 11:35:50,138 TRACE [org.infinispan.factories.InterceptorChainFactory] (testng) Finished building default interceptor chain. 11:35:50,135 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t1) NodeB-51742 --> DATA(NodeA-45995: #4, conn_id=0) 11:35:50,139 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t1) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=449, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:50,139 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,139 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (81 bytes) 11:35:50,140 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=449, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:50,140 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #4, conn_id=0) 11:35:50,140 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#4 11:35:50,140 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: FilterIndexingServiceProvider 11:35:50,140 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeA-45995) Responses: sender=NodeB-51742value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:50,143 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t5) Cluster members updated for cache dist, no abrupt leavers detected: cache members = [NodeA-45995, NodeB-51742]. Existing members = [NodeA-45995] 11:35:50,148 TRACE [org.infinispan.partitionhandling.impl.PreferAvailabilityStrategy] (transport-threadNodeA-p408-t5) Cache dist did not lose any members, skipping rebalance 11:35:50,149 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain size: 14 11:35:50,149 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain is: 11:35:50,149 TRACE [org.infinispan.transaction.xa.TransactionFactory] (testng) Setting factory enum to NODLD_NORECOVERY_NOXA 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationFailures [r=true,w=false,is=false,type=long] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationCount [r=true,w=false,is=false,type=long] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStatisticsEnabled 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.util.List locateKey 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isAffectedByRehash 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isLocatedLocally 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:50,149 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:50,163 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:50,164 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:50,168 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute storeWrites [r=true,w=false,is=false,type=long] 11:35:50,168 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:50,168 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:50,168 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,168 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=long] 11:35:50,168 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:50,168 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:50,172 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 11:35:50,179 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:50,179 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:50,179 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:50,179 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:50,179 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:50,179 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute invalidations [r=true,w=false,is=false,type=long] 11:35:50,179 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 11:35:50,198 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:50,203 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:50,203 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:50,203 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:50,203 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStaleStatsTreshold 11:35:50,203 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,203 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void disconnectSource 11:35:50,203 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:50,205 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void recordKnownGlobalKeyset 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:50,210 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:50,220 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:50,220 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,220 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute commits [r=true,w=false,is=false,type=long] 11:35:50,220 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rollbacks [r=true,w=false,is=false,type=long] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute prepares [r=true,w=false,is=false,type=long] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictionSize [r=true,w=true,is=false,type=long] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,225 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:50,235 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:50,235 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute elapsedTime [r=true,w=false,is=false,type=long] 11:35:50,236 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@7e8c64fc under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RpcManager 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3279b8ee under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@48ea3491 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@2f78bd46 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@32ce97d1 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Passivation 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@4d8fe7ae under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@54580c32 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 11:35:50,236 DEBUG [org.infinispan.jmx.JmxUtil] (testng) Object name infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3e201972 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Transactions 11:35:50,236 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@78166178 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Configuration 11:35:50,237 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@4a165b43 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=LockManager 11:35:50,237 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@5ebbf7af under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Activation 11:35:50,247 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@60ee8e83 under infinispan-52d71714-798c-4591-bcb4-590ef6490c23:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Statistics 11:35:50,247 TRACE [org.infinispan.jmx.CacheJmxRegistration] (testng) ISPN000031: MBeans were successfully registered to the platform MBean server. 11:35:50,247 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (testng) starting distribution manager on NodeB-51742 11:35:50,247 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Starting StateTransferManager of cache dist on node NodeB-51742 11:35:50,247 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Node NodeB-51742 joining cache dist 11:35:50,247 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeB-51742, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=748c0a51-6c51-4aa1-8769-895b223ff294, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1}, mode=SYNCHRONOUS, timeout=240000 11:35:50,248 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeB-51742, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=748c0a51-6c51-4aa1-8769-895b223ff294, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} to single recipient NodeA-45995 with response mode GET_ALL 11:35:50,248 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeB-51742: invoking unicast RPC [req-id=496] on NodeA-45995 11:35:50,248 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #5, conn_id=0) 11:35:50,251 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeB-51742: #4) 11:35:50,248 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=496, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:50,251 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are UNICAST3: ACK, seqno=4, ts=1, TP: [cluster_name=ISPN] 11:35:50,269 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,269 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (63 bytes) 11:35:50,254 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (162 bytes (810.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,270 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (165 bytes) 11:35:50,270 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=89 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=496, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:50,271 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #5, conn_id=0) 11:35:50,271 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#5 11:35:50,271 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 496 11:35:50,271 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeB-51742, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=748c0a51-6c51-4aa1-8769-895b223ff294, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} [sender=NodeB-51742] 11:35:50,272 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,275 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=4, ts=1, TP: [cluster_name=ISPN] 11:35:50,275 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeB-51742) NodeB-51742 <-- ACK(NodeA-45995: #4, conn-id=0, ts=1) 11:35:50,275 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t4) Added joiner NodeB-51742 to cache dist with persistent uuid 748c0a51-6c51-4aa1-8769-895b223ff294: members = [NodeA-45995, NodeB-51742], joiners = [NodeB-51742] 11:35:50,276 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t4) Queueing rebalance for cache dist with members [NodeA-45995, NodeB-51742] 11:35:50,279 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t4) Rebalancing consistent hash for cache dist, members are [NodeA-45995, NodeB-51742] 11:35:50,288 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t4) Updating cache dist topology for rebalance: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,288 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t4) Cache dist topology updated: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, members = [NodeA-45995, NodeB-51742], joiners = [NodeB-51742] 11:35:50,288 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t4) Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 11:35:50,288 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t4) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,288 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t4) Initialized rebalance confirmation collector 2@dist, initial list is [NodeA-45995, NodeB-51742] 11:35:50,299 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t4) ISPN000310: Starting cluster-wide rebalance for cache dist, topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,299 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t4) [Context=dist][Scope=NodeA-45995]ISPN100002: Started local rebalance 11:35:50,313 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t4) dests=null, command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=240000 11:35:50,313 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t4) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} to single recipient NodeB-51742 with response mode GET_NONE 11:35:50,313 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} 11:35:50,313 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) Waiting on view 1 being accepted 11:35:50,319 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Updating local topology for cache dist: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,319 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Starting local rebalance for cache dist, topology = CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,319 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t4) NodeA-45995 --> DATA(NodeB-51742: #4, conn_id=1) 11:35:50,319 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t4) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,319 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 11:35:50,327 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,328 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (5429 bytes (27145.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,328 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (5432 bytes) 11:35:50,328 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t1) Installing new cache topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 256+0, NodeB-51742: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:50,328 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t4) About to send back response SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]}, stableTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]}}} for command CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeB-51742, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=748c0a51-6c51-4aa1-8769-895b223ff294, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} 11:35:50,328 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 256+0, NodeB-51742: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,328 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Start keeping track of keys for rebalance 11:35:50,328 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,328 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Tracking is disabled. Clear tracker: {} 11:35:50,328 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:50,328 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t1) Signalling topology 2 is installed 11:35:50,328 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=5358 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,328 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #4, conn_id=1) 11:35:50,328 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:50,328 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) On cache dist we have: added segments: []; removed segments: [] 11:35:50,328 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Topology update processed, stateTransferTopologyId = 2, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} 11:35:50,330 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t4) sending rsp for 496 to NodeB-51742 11:35:50,330 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t4) NodeA-45995 --> DATA(NodeB-51742: #5, conn_id=1) 11:35:50,330 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t4) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=496, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,330 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (4485 bytes (22425.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,328 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t1) Signalling transaction data received for topology 2 11:35:50,328 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#4 11:35:50,332 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:50,336 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} [sender=NodeA-45995] 11:35:50,332 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Finished receiving of segments for cache dist for topology 2. 11:35:50,336 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Stop keeping track of changed keys for state transfer 11:35:50,336 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,336 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Tracking is disabled. Clear tracker: {} 11:35:50,337 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:50,330 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (4488 bytes) 11:35:50,343 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeA-45995, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} 11:35:50,343 DEBUG [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t2) ISPN000328: Finished local rebalance for cache dist on node NodeA-45995, topology id = 2 11:35:50,346 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t2) [Context=dist][Scope=NodeA-45995]ISPN100003: Finished local rebalance 11:35:50,346 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-threadNodeA-p408-t2) Rebalance confirmation collector 2@dist received confirmation for NodeA-45995, remaining list is [NodeB-51742] 11:35:50,337 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:50,352 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,352 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Removing no longer owned entries for cache dist 11:35:50,355 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Topology changed, recalculating minTopologyId 11:35:50,355 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Changing minimum topology ID from 1 to 2 11:35:50,349 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=4412 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=496, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,349 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeB-51742) NodeB-51742 --> ACK(NodeA-45995: #4) 11:35:50,356 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are UNICAST3: ACK, seqno=4, conn_id=1, ts=1, TP: [cluster_name=ISPN] 11:35:50,356 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,356 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (63 bytes) 11:35:50,356 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=4, conn_id=1, ts=1, TP: [cluster_name=ISPN] 11:35:50,356 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- ACK(NodeB-51742: #4, conn-id=1, ts=1) 11:35:50,358 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #5, conn_id=1) 11:35:50,358 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#5 11:35:50,358 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]}, stableTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]}}} , received=true, suspected=false 11:35:50,358 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) Waiting on view 1 being accepted 11:35:50,358 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating local topology for cache dist: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:50,359 TRACE [org.infinispan.topology.CacheTopology] (testng) Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 11:35:50,359 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Installing new cache topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} on cache dist 11:35:50,359 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Received new topology for cache dist, isRebalance = false, isMember = false, topology = CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:50,359 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling topology 1 is installed 11:35:50,359 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Requesting cluster listeners of cache dist from node NodeA-45995 11:35:50,359 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:50,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_CACHE_LISTENERS, topologyId=1, segments=null}, mode=SYNCHRONOUS, timeout=240000 11:35:50,359 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} to single recipient NodeA-45995 with response mode GET_ALL 11:35:50,359 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeB-51742: invoking unicast RPC [req-id=514] on NodeA-45995 11:35:50,359 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #6, conn_id=0) 11:35:50,359 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=514, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 11:35:50,359 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (90 bytes (450.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,359 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (93 bytes) 11:35:50,362 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=17 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=514, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 11:35:50,362 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #6, conn_id=0) 11:35:50,362 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#6 11:35:50,362 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 514 11:35:50,363 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} [sender=NodeB-51742] 11:35:50,363 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,363 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} 11:35:50,363 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-threadNodeA-p406-t5) Request received to get cluster listeners currently registered 11:35:50,363 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-threadNodeA-p406-t5) Cluster listeners found [] 11:35:50,363 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} 11:35:50,366 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 514 to NodeB-51742 11:35:50,366 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeB-51742: #6, conn_id=1) 11:35:50,367 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=514, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,368 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,368 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (84 bytes) 11:35:50,370 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=514, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,370 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #6, conn_id=1) 11:35:50,370 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#6 11:35:50,370 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:50,375 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeB-51742) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:50,379 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) On cache dist we have: added segments: [] 11:35:50,379 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 11:35:50,383 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling transaction data received for topology 1 11:35:50,383 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:50,383 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,383 DEBUG [org.infinispan.transaction.impl.TransactionTable] (testng) Topology changed, recalculating minTopologyId 11:35:50,383 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Changing minimum topology ID from -1 to 1 11:35:50,383 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating stable topology for cache dist: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:50,384 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) StateTransferManager of cache dist on node NodeB-51742 received initial topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8]} 11:35:50,384 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=NodeB-51742, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1}, mode=SYNCHRONOUS, timeout=240000 11:35:50,384 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=NodeB-51742, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} to single recipient NodeA-45995 with response mode GET_ALL 11:35:50,385 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeB-51742: invoking unicast RPC [req-id=523] on NodeA-45995 11:35:50,385 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t3) Waiting on view 1 being accepted 11:35:50,385 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #7, conn_id=0) 11:35:50,388 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t3) Updating local topology for cache dist: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,389 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=523, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 11:35:50,389 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t3) Starting local rebalance for cache dist, topology = CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,389 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t3) Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0, 62: 0, 63: 0, 64: 0, 65: 0, 66: 0, 67: 0, 68: 0, 69: 0, 70: 0, 71: 0, 72: 0, 73: 0, 74: 0, 75: 0, 76: 0, 77: 0, 78: 0, 79: 0, 80: 0, 81: 0, 82: 0, 83: 0, 84: 0, 85: 0, 86: 0, 87: 0, 88: 0, 89: 0, 90: 0, 91: 0, 92: 0, 93: 0, 94: 0, 95: 0, 96: 0, 97: 0, 98: 0, 99: 0, 100: 0, 101: 0, 102: 0, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0, 111: 0, 112: 0, 113: 0, 114: 0, 115: 0, 116: 0, 117: 0, 118: 0, 119: 0, 120: 0, 121: 0, 122: 0, 123: 0, 124: 0, 125: 0, 126: 0, 127: 0, 128: 0, 129: 0, 130: 0, 131: 0, 132: 0, 133: 0, 134: 0, 135: 0, 136: 0, 137: 0, 138: 0, 139: 0, 140: 0, 141: 0, 142: 0, 143: 0, 144: 0, 145: 0, 146: 0, 147: 0, 148: 0, 149: 0, 150: 0, 151: 0, 152: 0, 153: 0, 154: 0, 155: 0, 156: 0, 157: 0, 158: 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 0, 165: 0, 166: 0, 167: 0, 168: 0, 169: 0, 170: 0, 171: 0, 172: 0, 173: 0, 174: 0, 175: 0, 176: 0, 177: 0, 178: 0, 179: 0, 180: 0, 181: 0, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0, 188: 0, 189: 0, 190: 0, 191: 0, 192: 0, 193: 0, 194: 0, 195: 0, 196: 0, 197: 0, 198: 0, 199: 0, 200: 0, 201: 0, 202: 0, 203: 0, 204: 0, 205: 0, 206: 0, 207: 0, 208: 0, 209: 0, 210: 0, 211: 0, 212: 0, 213: 0, 214: 0, 215: 0, 216: 0, 217: 0, 218: 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0, 224: 0, 225: 0, 226: 0, 227: 0, 228: 0, 229: 0, 230: 0, 231: 0, 232: 0, 233: 0, 234: 0, 235: 0, 236: 0, 237: 0, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 0, 250: 0, 251: 0, 252: 0, 253: 0, 254: 0, 255: 0 11:35:50,389 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t3) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,389 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t3) Installing new cache topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 256+0, NodeB-51742: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:50,389 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (89 bytes (445.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,389 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t3) This is the first topology 2 in which the local node is a member 11:35:50,389 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (92 bytes) 11:35:50,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 256+0, NodeB-51742: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Start keeping track of keys for rebalance 11:35:50,389 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,389 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t3) Tracking is disabled. Clear tracker: {} 11:35:50,389 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t3) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:50,389 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling topology 2 is installed 11:35:50,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [] 11:35:50,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: added segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; removed segments: [] 11:35:50,389 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist 11:35:50,389 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=16 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=523, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 11:35:50,389 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #7, conn_id=0) 11:35:50,389 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#7 11:35:50,389 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 523 11:35:50,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Requesting transactions for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist from node NodeA-45995 11:35:50,389 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeB-p417-t3) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:50,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t3) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}, mode=SYNCHRONOUS, timeout=240000 11:35:50,389 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t3) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} to single recipient NodeA-45995 with response mode GET_ALL 11:35:50,392 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeB-p417-t3) NodeB-51742: invoking unicast RPC [req-id=524] on NodeA-45995 11:35:50,389 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeB-51742] 11:35:50,393 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:50,396 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 523 to NodeB-51742 11:35:50,393 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,392 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t3) NodeB-51742 --> DATA(NodeA-45995: #8, conn_id=0) 11:35:50,397 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t3) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=524, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 11:35:50,396 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #7, conn_id=1) 11:35:50,397 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=523, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,397 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (1392 bytes (6960.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,397 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (1395 bytes) 11:35:50,397 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,397 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (81 bytes) 11:35:50,399 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=523, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,399 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #7, conn_id=1) 11:35:50,399 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#7 11:35:50,399 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:50,399 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Waiting for initial state transfer to finish for cache dist on NodeB-51742 11:35:50,400 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=1319 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=524, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 11:35:50,400 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #8, conn_id=0) 11:35:50,402 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#8 11:35:50,402 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 524 11:35:50,406 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} [sender=NodeB-51742] 11:35:50,411 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t6) Calling perform() on StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} 11:35:50,411 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t6) Received request for transactions from node NodeB-51742 for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist with topology id 2 11:35:50,412 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t6) Found 0 transaction(s) to transfer 11:35:50,418 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} 11:35:50,418 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 524 to NodeB-51742 11:35:50,418 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #8, conn_id=1) 11:35:50,418 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=524, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,418 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,418 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (84 bytes) 11:35:50,418 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=524, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,418 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #8, conn_id=1) 11:35:50,418 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#8 11:35:50,418 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:50,411 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,418 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeB-51742) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:50,435 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Applying 0 transactions for cache dist transferred from node NodeA-45995 11:35:50,435 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Adding transfer from NodeA-45995 for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:50,437 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Finished adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist 11:35:50,437 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Topology update processed, stateTransferTopologyId = 2, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} 11:35:50,437 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling transaction data received for topology 2 11:35:50,439 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:50,439 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,439 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Removing no longer owned entries for cache dist 11:35:50,439 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) Requesting segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist from node NodeA-45995 11:35:50,439 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:50,439 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeB-p427-t1) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:50,440 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeB-p427-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} to addresses [NodeA-45995] with response mode GET_ALL 11:35:50,444 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Topology changed, recalculating minTopologyId 11:35:50,444 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Changing minimum topology ID from 1 to 2 11:35:50,445 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: invoking multicast RPC [req-id=536] 11:35:50,446 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 --> DATA(NodeA-45995: #9, conn_id=0) 11:35:50,446 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=536, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 11:35:50,446 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (1392 bytes (6960.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,446 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (1395 bytes) 11:35:50,450 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=1319 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=536, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 11:35:50,450 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #9, conn_id=0) 11:35:50,450 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#9 11:35:50,450 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 536 11:35:50,461 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} [sender=NodeB-51742] 11:35:50,461 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,462 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t6) Calling perform() on StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} 11:35:50,462 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t6) Starting outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] to node NodeB-51742 with topology id 2 for cache dist 11:35:50,462 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t6) Adding outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] to NodeB-51742 11:35:50,462 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} 11:35:50,462 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 536 to NodeB-51742 11:35:50,462 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t3) Sending last chunk containing 0 cache entries from segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist to node NodeB-51742 11:35:50,462 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t3) NodeA-45995 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=2} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:50,462 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t3) dests=[NodeB-51742], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=2}, mode=SYNCHRONOUS, timeout=240000 11:35:50,468 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t3) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=2} to single recipient NodeB-51742 with response mode GET_ALL 11:35:50,468 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t3) NodeA-45995: invoking unicast RPC [req-id=538] on NodeB-51742 11:35:50,468 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t3) NodeA-45995 --> DATA(NodeB-51742: #10, conn_id=1) 11:35:50,468 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t3) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=538, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,468 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (2159 bytes (10795.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,468 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (2162 bytes) 11:35:50,476 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=2086 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=538, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,476 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #10, conn_id=1) 11:35:50,476 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#10 11:35:50,476 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 538 11:35:50,478 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=2} [sender=NodeA-45995] 11:35:50,462 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #9, conn_id=1) 11:35:50,478 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeB-51742) Checking if transaction data was received for topology 0, current topology is 2 11:35:50,478 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=536, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,479 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,479 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (80 bytes) 11:35:50,492 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t4) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=2} 11:35:50,492 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:50,496 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Before applying the received state the data container of cache dist has 0 keys 11:35:50,489 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=536, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,498 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #9, conn_id=1) 11:35:50,498 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeA-45995#9 11:35:50,498 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeB-51742) Responses: Responses{ NodeA-45995: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:50,498 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeB-51742) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=2, segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:50,499 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) Successfully requested segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist from node NodeA-45995 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], finishedSegments=[], unfinishedSegments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@376e910c[Not completed], topologyId=2, timeout=240000, cacheName=dist} 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 1 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 1 of cache dist 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 4 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 4 of cache dist 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 2 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 5 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 5 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 6 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 6 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 7 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 7 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 8 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 8 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 9 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 9 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 10 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 10 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 11 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 11 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 12 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 12 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 13 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 13 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 14 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 14 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 15 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 15 of cache dist 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 16 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,501 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 16 of cache dist 11:35:50,502 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 17 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,502 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 17 of cache dist 11:35:50,502 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 18 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,502 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 18 of cache dist 11:35:50,502 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 2 of cache dist 11:35:50,502 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 19 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 3 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,505 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 3 of cache dist 11:35:50,499 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 0 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,505 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 19 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 23 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 23 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 24 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 24 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 25 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 25 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 26 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 26 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 27 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 27 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 28 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 22 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 22 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 28 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 30 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 30 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 31 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 31 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 32 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 32 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 33 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 33 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 34 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 34 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 35 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 35 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 36 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 36 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 37 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 37 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 38 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 38 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 39 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 39 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 40 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 40 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 41 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 41 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 42 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 42 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 43 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 43 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 44 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 44 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 45 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 45 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 46 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 46 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 47 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 47 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 48 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 48 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 49 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 49 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 50 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 50 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 51 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 51 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 52 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 52 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 53 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 53 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 54 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 54 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 55 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 55 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 56 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 56 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 57 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 57 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 58 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 58 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 59 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 59 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 60 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 60 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 61 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 61 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 62 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 62 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 63 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 63 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 64 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 64 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 65 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 65 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 66 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 66 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 67 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 67 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 68 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 68 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 69 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 69 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 70 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 70 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 71 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 71 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 72 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 72 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 73 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 73 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 74 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 74 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 75 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 75 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 76 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 76 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 77 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 77 of cache dist 11:35:50,509 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 78 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 78 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 79 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 79 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 80 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 80 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 81 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 81 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 82 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 82 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 83 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 83 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 84 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 84 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 85 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 85 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 86 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 86 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 87 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 87 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 21 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 21 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 29 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 20 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 20 of cache dist 11:35:50,508 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 0 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 29 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 88 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 88 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 93 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 91 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 91 of cache dist 11:35:50,511 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 92 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,511 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 92 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 89 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 93 of cache dist 11:35:50,518 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 89 of cache dist 11:35:50,510 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 90 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 97 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 95 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 94 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 94 of cache dist 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 97 of cache dist 11:35:50,526 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 98 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 96 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,526 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 98 of cache dist 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 90 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 96 of cache dist 11:35:50,526 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 99 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 99 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 103 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 103 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 102 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 104 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 104 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 105 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 105 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 106 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 101 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 101 of cache dist 11:35:50,521 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 95 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 106 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 109 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 109 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 110 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 108 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 108 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 107 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 107 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 102 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 110 of cache dist 11:35:50,541 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 112 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,541 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 112 of cache dist 11:35:50,541 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 113 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,546 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 113 of cache dist 11:35:50,537 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 100 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,546 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 100 of cache dist 11:35:50,541 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 111 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,541 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 114 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,552 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 111 of cache dist 11:35:50,552 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 114 of cache dist 11:35:50,559 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 117 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,559 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 116 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,559 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 116 of cache dist 11:35:50,559 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 118 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,559 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 118 of cache dist 11:35:50,559 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 115 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,563 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 117 of cache dist 11:35:50,559 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 119 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 119 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 123 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 123 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 124 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 124 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 125 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 125 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 126 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 126 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 127 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 127 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 120 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 121 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 121 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 122 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 122 of cache dist 11:35:50,563 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 115 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 120 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 132 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 132 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 133 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 133 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 129 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 129 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 128 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 128 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 130 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,586 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 130 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 131 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 131 of cache dist 11:35:50,584 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 134 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 134 of cache dist 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 136 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 136 of cache dist 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 138 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 138 of cache dist 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 137 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 137 of cache dist 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 135 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 135 of cache dist 11:35:50,587 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 139 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 139 of cache dist 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 144 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 140 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 141 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 141 of cache dist 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 143 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 143 of cache dist 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 140 of cache dist 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 142 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,593 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 142 of cache dist 11:35:50,592 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 144 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 148 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 146 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 146 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 147 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 147 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 148 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 149 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 149 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 153 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 153 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 154 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 154 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 155 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 155 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 156 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 156 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 157 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 157 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 158 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 158 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 159 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 159 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 160 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 160 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 161 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 161 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 162 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 162 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 163 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 163 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 164 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 164 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 165 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 165 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 166 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 166 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 167 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 167 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 168 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 168 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 169 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 169 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 170 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 170 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 171 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 171 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 172 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 172 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 173 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 173 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 174 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 174 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 175 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 175 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 176 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 176 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 177 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 177 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 178 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 178 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 179 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 179 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 180 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 180 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 181 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 181 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 182 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 182 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 183 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 183 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 184 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 184 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 185 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 185 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 186 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 186 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 187 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 187 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 188 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 188 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 189 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 189 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 190 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 190 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 191 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 191 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 192 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 192 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 193 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 193 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 194 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 194 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 195 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 195 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 196 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 196 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 197 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 197 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 198 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 198 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 199 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 199 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 200 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 200 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 201 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 201 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 202 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 202 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 203 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 203 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 204 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 204 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 205 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 205 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 206 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 206 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 207 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 207 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 208 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 208 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 209 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 209 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 210 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 210 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 211 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 211 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 212 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 212 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 213 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 213 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 214 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 214 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 215 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 215 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 216 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 216 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 217 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 217 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 218 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 218 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 219 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 219 of cache dist 11:35:50,595 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 220 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 220 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 221 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 221 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 222 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 222 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 223 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 223 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 224 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 224 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 225 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 225 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 226 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 226 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 227 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 227 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 228 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 228 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 229 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 229 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 230 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 230 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 231 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 231 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 232 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 232 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 233 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 233 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 234 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 234 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 235 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 235 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 236 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 236 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 237 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 237 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 238 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 238 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 239 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 239 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 240 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 240 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 241 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 241 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 242 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 242 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 243 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 243 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 244 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 244 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 245 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 245 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 246 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 246 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 247 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 247 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 248 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 248 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 249 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 249 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 250 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 250 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 251 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 251 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 252 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 252 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 253 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 253 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 254 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 254 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Applying new state chunk for segment 255 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Finished applying chunk of segment 255 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 145 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 150 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,601 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 150 of cache dist 11:35:50,596 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 145 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 152 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,601 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 152 of cache dist 11:35:50,594 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 151 of cache dist from node NodeA-45995: received 0 cache entries 11:35:50,601 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 151 of cache dist 11:35:50,601 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) Finished receiving state for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist 11:35:50,611 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Inbound transfer finished: InboundTransferTask{segments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], finishedSegments=[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255], unfinishedSegments=[], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@376e910c[Completed normally], topologyId=2, timeout=240000, cacheName=dist} 11:35:50,611 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Removing inbound transfers for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] from source NodeA-45995 for cache dist 11:35:50,612 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished receiving of segments for cache dist for topology 2. 11:35:50,612 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Stop keeping track of changed keys for state transfer 11:35:50,612 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeB-p427-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,612 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeB-p427-t1) Tracking is disabled. Clear tracker: {} 11:35:50,612 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeB-p427-t1) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=0 11:35:50,612 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeB-p427-t1) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} to single recipient NodeA-45995 with response mode GET_NONE 11:35:50,612 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 --> DATA(NodeA-45995: #10, conn_id=0) 11:35:50,612 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 11:35:50,620 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) After applying the received state the data container of cache dist has 0 keys 11:35:50,612 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,625 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (119 bytes) 11:35:50,626 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 11:35:50,626 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #10, conn_id=0) 11:35:50,626 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#10 11:35:50,626 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:50,626 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=2, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=1} [sender=NodeB-51742] 11:35:50,626 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,626 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) ISPN000328: Finished local rebalance for cache dist on node NodeB-51742, topology id = 2 11:35:50,626 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) [Context=dist][Scope=NodeB-51742]ISPN100003: Finished local rebalance 11:35:50,624 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t4) Segments not received yet for cache dist: {} 11:35:50,626 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t4) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=2} 11:35:50,626 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t4) sending rsp for 538 to NodeA-45995 11:35:50,626 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t4) NodeB-51742 --> DATA(NodeA-45995: #11, conn_id=0) 11:35:50,630 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t6) Rebalance confirmation collector 2@dist received confirmation for NodeB-51742, remaining list is [] 11:35:50,631 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) ISPN000336: Finished cluster-wide rebalance for cache dist, topology id = 2 11:35:50,631 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Cache dist topology updated: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, members = [NodeA-45995, NodeB-51742], joiners = [] 11:35:50,631 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t6) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,631 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t6) Updating cluster-wide current topology for cache dist, topology = CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, availability mode = AVAILABLE 11:35:50,631 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t6) dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=240000 11:35:50,631 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} 11:35:50,631 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} to single recipient NodeB-51742 with response mode GET_NONE 11:35:50,631 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t4) Waiting on view 1 being accepted 11:35:50,631 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #11, conn_id=1) 11:35:50,635 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,636 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Updating stable topology for cache dist: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (3339 bytes (16695.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,636 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t6) Updating cluster-wide stable topology for cache dist, topology = CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (3342 bytes) 11:35:50,636 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t6) dests=null, command=CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1}, mode=ASYNCHRONOUS, timeout=240000 11:35:50,636 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} 11:35:50,636 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} to single recipient NodeB-51742 with response mode GET_NONE 11:35:50,636 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #12, conn_id=1) 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (3338 bytes (16690.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=3268 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (3341 bytes) 11:35:50,636 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #11, conn_id=1) 11:35:50,636 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeA-45995#11 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=3267 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 11:35:50,626 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t4) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=538, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,636 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #12, conn_id=1) 11:35:50,637 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#12 11:35:50,637 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:50,636 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:50,637 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} [sender=NodeA-45995] 11:35:50,635 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t4) Updating local topology for cache dist: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,637 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t4) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,637 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=1} [sender=NodeA-45995] 11:35:50,637 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:50,637 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:50,637 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t4) Updating stable topology for cache dist: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,637 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t4) Waiting on view 1 being accepted 11:35:50,637 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t4) Updating local topology for cache dist: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,637 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t4) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,637 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t4) Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:50,637 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t4) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,637 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t4) Signalling topology 3 is installed 11:35:50,637 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t4) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:50,637 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t4) On cache dist we have: added segments: []; removed segments: [] 11:35:50,637 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t4) Topology update processed, stateTransferTopologyId = 2, startRebalance = false, pending CH = null 11:35:50,637 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t4) Stop keeping track of changed keys for state transfer 11:35:50,637 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t4) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,637 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t4) Tracking is disabled. Clear tracker: {} 11:35:50,637 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} with new topology 3 and was pre false 11:35:50,637 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t4) No change listeners present! 11:35:50,637 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t4) Unlock State Transfer in Progress for topology ID 3 11:35:50,637 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t4) Signalling transaction data received for topology 3 11:35:50,637 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t4) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:50,637 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t4) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,637 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t4) Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:50,638 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t4) Removing no longer owned entries for cache dist 11:35:50,638 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t4) Topology changed, recalculating minTopologyId 11:35:50,638 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t4) Changing minimum topology ID from 2 to 3 11:35:50,638 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,638 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t4) Signalling topology 3 is installed 11:35:50,638 DEBUG [org.infinispan.cache.impl.CacheImpl] (testng) Started cache dist on NodeB-51742 11:35:50,638 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Closing latch for cache dist 11:35:50,638 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:50,638 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) On cache dist we have: added segments: []; removed segments: [] 11:35:50,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (78 bytes) 11:35:50,639 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: ModuleLifecycle 11:35:50,638 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Topology update processed, stateTransferTopologyId = 2, startRebalance = false, pending CH = null 11:35:50,639 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Stop keeping track of changed keys for state transfer 11:35:50,640 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: CoreTestMetadataFileFinder 11:35:50,638 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t4) Initial state transfer complete for cache dist on node NodeB-51742 11:35:50,639 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t4) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,644 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t4) Tracking is disabled. Clear tracker: {} 11:35:50,644 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[NodeA-45995: 256+0]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} with new topology 3 and was pre false 11:35:50,644 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t4) No change listeners present! 11:35:50,644 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Unlock State Transfer in Progress for topology ID 3 11:35:50,644 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t4) Signalling transaction data received for topology 3 11:35:50,644 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:50,639 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=538, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 11:35:50,644 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #11, conn_id=0) 11:35:50,644 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#11 11:35:50,644 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: sender=NodeB-51742, received=true, suspected=false 11:35:50,644 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=2} is {NodeB-51742=SuccessfulResponse{responseValue=null} } 11:35:50,644 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t3) Outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist to node NodeB-51742 is complete 11:35:50,644 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeA-p408-t3) Removing completed outbound transfer of segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] to NodeB-51742 for cache dist 11:35:50,644 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,646 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: TestModuleCommandExtensions 11:35:50,646 DEBUG [org.infinispan.util.ModuleProperties] (testng) Loading module command extension SPI class: org.infinispan.remoting.rpc.TestModuleCommandExtensions@6987ac4f 11:35:50,645 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Removing no longer owned entries for cache dist 11:35:50,646 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Topology changed, recalculating minTopologyId 11:35:50,646 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Changing minimum topology ID from 2 to 3 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String pushState 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String cancelPushState 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String takeSiteOffline 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String bringSiteOnline 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterAvailability [r=true,w=false,is=false,type=java.lang.String] 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute nodeAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:50,646 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute physicalAddresses [r=true,w=false,is=false,type=java.lang.String] 11:35:50,648 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinator [r=true,w=false,is=true,type=boolean] 11:35:50,648 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinatorAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:50,648 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:50,648 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute createdCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:50,648 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterName [r=true,w=false,is=false,type=java.lang.String] 11:35:50,646 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t4) Updating stable topology for cache dist: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:50,648 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute name [r=true,w=false,is=false,type=java.lang.String] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheNames [r=true,w=false,is=false,type=java.lang.String] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute runningCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheManagerStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterSize [r=true,w=false,is=false,type=int] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheConfigurationNames [r=true,w=false,is=false,type=java.lang.String] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute globalConfigurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:50,651 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterMembers [r=true,w=false,is=false,type=java.lang.String] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:50,652 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:50,658 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:50,658 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:50,658 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:50,658 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:50,658 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:50,658 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,658 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@4f8d49cf under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=GlobalXSiteAdminOperations 11:35:50,658 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@689a24ab under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=LocalTopologyManager 11:35:50,658 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3e83f6ed under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=CacheManager 11:35:50,658 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@282cf5fc under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=CacheContainerStats 11:35:50,661 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000078: Starting JGroups channel ISPN 11:35:50,666 DEBUG [org.jgroups.stack.Configurator] (testng) set property TCP_NIO2.diagnostics_addr to default value /224.0.75.75 11:35:50,678 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:50,683 TRACE [org.jgroups.protocols.UNICAST3] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:50,683 TRACE [org.jgroups.blocks.MessageDispatcher] (testng) setting local_addr (null) to NodeC-21874 11:35:50,684 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeC-21874: stable task started 11:35:50,684 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Discovery.stopped=false 11:35:50,685 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) address=NodeC-21874, cluster=ISPN, physical address=127.0.0.1:8302 11:35:50,689 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Added discovery for NodeC-21874. Registered discoveries: {NodeA-45995=TEST_PING@NodeA-45995, NodeC-21874=TEST_PING@NodeC-21874, NodeB-51742=TEST_PING@NodeB-51742} 11:35:50,689 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeA-45995 with physical address 127.0.0.1:8300 in TEST_PING@NodeC-21874 11:35:50,689 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeC-21874 with physical address 127.0.0.1:8302 in TEST_PING@NodeA-45995 11:35:50,693 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Returning ping rsp: NodeA-45995, name=NodeA-45995, addr=127.0.0.1:8300, coord 11:35:50,693 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Skipping sending discovery to self 11:35:50,693 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeB-51742 with physical address 127.0.0.1:8301 in TEST_PING@NodeC-21874 11:35:50,693 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeC-21874 with physical address 127.0.0.1:8302 in TEST_PING@NodeB-51742 11:35:50,693 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Returning ping rsp: NodeB-51742, name=NodeB-51742, addr=127.0.0.1:8301, server 11:35:50,693 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeC-21874: discovery took 4 ms, members: 2 rsps (1 coords) [done] 11:35:50,693 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeC-21874: sending JOIN(NodeC-21874) to NodeA-45995 11:35:50,693 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874: created sender window for NodeA-45995 (conn-id=0) 11:35:50,694 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #1, conn_id=0, first) 11:35:50,694 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are GMS: GmsHeader[JOIN_REQ]: mbr=NodeC-21874, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:50,694 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,711 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (86 bytes) 11:35:50,714 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) 127.0.0.1:8302: connecting to 127.0.0.1:8300 11:35:50,717 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_REQ]: mbr=NodeC-21874, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:50,720 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #1, conn_id=0, first) 11:35:50,720 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: created receiver window for NodeC-21874 at seqno=#1 for conn-id=0 11:35:50,723 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeC-21874#1 11:35:50,724 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: joiners=[NodeC-21874], suspected=[], leaving=[], new view: [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,724 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) suspending message garbage collection 11:35:50,731 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) NodeA-45995: resume task started, max_suspend_time=33000 11:35:50,732 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: mcasting view [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] (3 mbrs) 11:35:50,733 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (ViewHandler,NodeA-45995) NodeA-45995: sending NodeA-45995#2 11:35:50,733 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to null, src=NodeA-45995, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 11:35:50,733 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: looping back message [dst: , src: NodeA-45995 (3 headers), size=61 bytes] 11:35:50,733 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 11:35:50,733 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: received NodeA-45995#2 11:35:50,733 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: delivering NodeA-45995#2-2 (1 messages) 11:35:50,733 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: received delta view [NodeA-45995|2], ref-view=[NodeA-45995|1], joined=[NodeC-21874] 11:35:50,738 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: installing view [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,738 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1] 11:35:50,738 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeA-45995) Handle view [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,738 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeA-45995) new membership: [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,738 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,738 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) New view accepted: [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,733 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (112 bytes (560.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:50,739 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (115 bytes) 11:35:50,739 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 11:35:50,739 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: received NodeA-45995#2 11:35:50,740 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#2-2 (1 messages) 11:35:50,740 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: received delta view [NodeA-45995|2], ref-view=[NodeA-45995|1], joined=[NodeC-21874] 11:35:50,740 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (115 bytes) 11:35:50,740 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 11:35:50,740 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: message NodeA-45995::2 was added to queue (not yet server) 11:35:50,739 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) Joined: [NodeC-21874], Left: [] 11:35:50,743 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,743 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t2) Received new cluster view: 2, isCoordinator = true, old status = COORDINATOR 11:35:50,743 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t2) Updating cluster members for all the caches. New list is [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,743 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t2) dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 11:35:50,743 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeA-45995) ISPN100000: Node NodeC-21874 joined the cluster 11:35:50,743 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t2) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to addresses null with response mode GET_ALL 11:35:50,743 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t2) NodeA-45995: invoking multicast RPC [req-id=577] 11:35:50,743 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-threadNodeA-p408-t2) NodeA-45995: sending NodeA-45995#3 11:35:50,743 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t2) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=577, rsp_expected=true, NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 11:35:50,743 TRACE [org.jgroups.protocols.MFC] (transport-threadNodeA-p408-t2) NodeA-45995 used 8 credits, 1999992 remaining 11:35:50,743 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:50,743 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:50,743 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,743 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742], localAddress=NodeA-45995, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562954248388608 11:35:50,745 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742], localAddress=NodeA-45995, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562954248388608 11:35:50,745 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995 --> DATA(NodeA-45995: #2, conn_id=0) 11:35:50,745 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: sending msg to NodeA-45995, src=NodeA-45995, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:50,745 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: looping back message [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 11:35:50,747 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:50,747 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- DATA(NodeA-45995: #2, conn_id=0) 11:35:50,743 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: installing view [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,751 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995: delivering NodeA-45995#2 11:35:50,743 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (64 bytes) 11:35:50,760 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (64 bytes) 11:35:50,760 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=577, rsp_expected=true, NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 11:35:50,760 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeB-51742) NodeB-51742: received NodeA-45995#3 11:35:50,760 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeA-45995#3 11:35:50,760 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 577 11:35:50,760 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:50,760 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:50,760 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeB-51742) NodeA-45995 used 8 credits, 1999992 remaining 11:35:50,761 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=577, rsp_expected=true, NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 11:35:50,761 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:50,761 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 577 to NodeA-45995 11:35:50,761 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeA-45995: #12, conn_id=0) 11:35:50,761 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=577, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 11:35:50,761 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,761 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: message NodeA-45995::3 was added to queue (not yet server) 11:35:50,764 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (81 bytes) 11:35:50,764 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeB-51742) NodeB-51742: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1] 11:35:50,765 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeB-51742) Handle view [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,765 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeB-51742) new membership: [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,768 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:50,768 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) New view accepted: [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,768 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) Joined: [NodeC-21874], Left: [] 11:35:50,768 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,768 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeB-p417-t5) Received new cluster view: 2, isCoordinator = false, old status = REGULAR_MEMBER 11:35:50,768 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeB-51742) ISPN100000: Node NodeC-21874 joined the cluster 11:35:50,765 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=577, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 11:35:50,768 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:50,768 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742], localAddress=NodeB-51742, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562958543355904 11:35:50,768 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742], localAddress=NodeB-51742, viewId=2, subgroupsMerged=null, mergeView=false} and result was 562958543355904 11:35:50,772 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742 --> DATA(NodeA-45995: #13, conn_id=0) 11:35:50,772 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 11:35:50,772 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeA-45995) NodeA-45995 --> ACK(NodeC-21874: #1) 11:35:50,772 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are UNICAST3: ACK, seqno=1, ts=2, TP: [cluster_name=ISPN] 11:35:50,772 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeA-45995) NodeA-45995 --> ACK(NodeB-51742: #11) 11:35:50,772 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are UNICAST3: ACK, seqno=11, ts=3, TP: [cluster_name=ISPN] 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeB-51742] 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (63 bytes) 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (63 bytes) 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=11, ts=3, TP: [cluster_name=ISPN] 11:35:50,773 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742 <-- ACK(NodeA-45995: #11, conn-id=0, ts=3) 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=1, ts=2, TP: [cluster_name=ISPN] 11:35:50,773 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeC-21874) NodeC-21874 <-- ACK(NodeA-45995: #1, conn-id=0, ts=2) 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (70 bytes) 11:35:50,768 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:50,776 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #12, conn_id=0) 11:35:50,776 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#12 11:35:50,773 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 11:35:50,792 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #13, conn_id=0) 11:35:50,792 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#13 11:35:50,792 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (2) from members for view [NodeA-45995|2] 11:35:50,794 TRACE [org.jgroups.protocols.UNICAST3] (ViewHandler,NodeA-45995) NodeA-45995: created sender window for NodeC-21874 (conn-id=2) 11:35:50,794 TRACE [org.jgroups.protocols.UNICAST3] (ViewHandler,NodeA-45995) NodeA-45995 --> DATA(NodeC-21874: #1, conn_id=2, first) 11:35:50,794 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:50,794 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (152 bytes (760.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:50,794 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (155 bytes) 11:35:50,803 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=81 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:50,803 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #1, conn_id=2, first) 11:35:50,803 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeC-21874) NodeC-21874: created receiver window for NodeA-45995 at seqno=#1 for conn-id=2 11:35:50,803 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeC-21874) NodeC-21874: delivering NodeA-45995#1 11:35:50,804 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (testng) [NodeC-21874 setDigest()] new digest: NodeA-45995: [1 (1)], NodeB-51742: [0 (0)], NodeC-21874: [0 (0)] resulting digest: NodeA-45995: [1 (1)], NodeB-51742: [0 (0)], NodeC-21874: [0 (0)] 11:35:50,804 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeC-21874: installing view [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,804 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeC-21874: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1] 11:35:50,804 TRACE [org.jgroups.protocols.tom.TOA] (testng) Handle view [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,805 TRACE [org.jgroups.protocols.MFC] (testng) new membership: [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,813 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (testng) Added a new task directly: 0 task(s) are waiting 11:35:50,814 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) New view accepted: [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,814 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|2] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,814 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (testng) NodeC-21874: flushing become_server_queue (2 elements) 11:35:50,814 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #2, conn_id=0) 11:35:50,814 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#3 11:35:50,814 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: received NodeA-45995#2 11:35:50,814 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:50,814 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#3 11:35:50,814 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 577 11:35:50,814 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#2-2 (1 messages) 11:35:50,814 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000079: Channel ISPN local address is NodeC-21874, physical addresses are [127.0.0.1:8302] 11:35:50,814 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:50,814 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:50,814 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 8 credits, 1999992 remaining 11:35:50,814 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,814 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (70 bytes) 11:35:50,814 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=24000 11:35:50,814 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient NodeA-45995 with response mode GET_ALL 11:35:50,814 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeC-p460-t1) Received new cluster view: 2, isCoordinator = false, old status = INITIALIZING 11:35:50,814 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeC-21874: invoking unicast RPC [req-id=586] on NodeA-45995 11:35:50,814 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #3, conn_id=0) 11:35:50,814 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=586, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:50,814 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:50,814 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #2, conn_id=0) 11:35:50,814 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#2 11:35:50,814 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,814 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (1) from joiners for view [NodeA-45995|2] 11:35:50,814 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (84 bytes) 11:35:50,814 TRACE [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1] 11:35:50,815 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) resuming message garbage collection 11:35:50,815 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=586, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:50,815 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #3, conn_id=0) 11:35:50,815 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#3 11:35:50,815 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 586 11:35:50,815 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeC-21874] 11:35:50,815 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,815 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:50,815 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 586 to NodeC-21874 11:35:50,815 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeC-21874: #2, conn_id=2) 11:35:50,815 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=586, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:50,815 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:50,815 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (81 bytes) 11:35:50,815 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=586, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:50,816 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #2, conn_id=2) 11:35:50,816 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#2 11:35:50,816 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:50,816 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Starting LocalTopologyManager on NodeC-21874 11:35:50,819 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t2) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:50,819 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t2) sending rsp for 577 to NodeA-45995 11:35:50,819 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t2) NodeC-21874 --> DATA(NodeA-45995: #4, conn_id=0) 11:35:50,819 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t2) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=577, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:50,819 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,819 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (81 bytes) 11:35:50,819 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=577, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:50,819 DEBUG [org.infinispan.manager.DefaultCacheManager] (testng) Started cache manager ISPN on NodeC 11:35:50,857 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeB-51742) NodeB-51742 --> ACK(NodeA-45995: #12) 11:35:50,857 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are UNICAST3: ACK, seqno=12, conn_id=1, ts=2, TP: [cluster_name=ISPN] 11:35:50,881 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) About to wire and start cache dist 11:35:50,889 INFO [org.infinispan.transaction.lookup.JBossStandaloneJTAManagerLookup] (testng) ISPN000107: Retrieving transaction manager Transaction: unknown 11:35:50,819 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #4, conn_id=0) 11:35:50,890 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#4 11:35:50,890 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: Responses{ NodeC-21874: sender=NodeC-21874value=SuccessfulResponse{responseValue=true} , received=true, suspected=false NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=true} , received=true, suspected=false} 11:35:50,890 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t2) Cluster members updated for cache dist, no abrupt leavers detected: cache members = [NodeA-45995, NodeB-51742, NodeC-21874]. Existing members = [NodeA-45995, NodeB-51742] 11:35:50,890 TRACE [org.infinispan.partitionhandling.impl.PreferAvailabilityStrategy] (transport-threadNodeA-p408-t2) Cache dist did not lose any members, skipping rebalance 11:35:50,897 TRACE [org.infinispan.factories.InterceptorChainFactory] (testng) Finished building default interceptor chain. 11:35:50,898 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,901 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (63 bytes) 11:35:50,909 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: FilterIndexingServiceProvider 11:35:50,901 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=12, conn_id=1, ts=2, TP: [cluster_name=ISPN] 11:35:50,910 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- ACK(NodeB-51742: #12, conn-id=1, ts=2) 11:35:50,923 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain size: 14 11:35:50,923 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain is: 11:35:50,923 TRACE [org.infinispan.transaction.xa.TransactionFactory] (testng) Setting factory enum to NODLD_NORECOVERY_NOXA 11:35:50,928 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictionSize [r=true,w=true,is=false,type=long] 11:35:50,928 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.util.List locateKey 11:35:50,928 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isLocatedLocally 11:35:50,928 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isAffectedByRehash 11:35:50,929 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,929 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 11:35:50,929 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationCount [r=true,w=false,is=false,type=long] 11:35:50,929 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationFailures [r=true,w=false,is=false,type=long] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStatisticsEnabled 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute commits [r=true,w=false,is=false,type=long] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute prepares [r=true,w=false,is=false,type=long] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rollbacks [r=true,w=false,is=false,type=long] 11:35:50,930 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,932 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:50,932 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void recordKnownGlobalKeyset 11:35:50,932 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:50,932 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void disconnectSource 11:35:50,932 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:50,932 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:50,932 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 11:35:50,933 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:50,933 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:50,933 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:50,935 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:50,935 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:50,935 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,935 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:50,935 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:50,937 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:50,938 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:50,939 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute invalidations [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute storeWrites [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStaleStatsTreshold 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute elapsedTime [r=true,w=false,is=false,type=long] 11:35:50,942 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:50,942 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@3bf59a7 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Configuration 11:35:50,942 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@249c6ab7 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 11:35:50,942 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@56f9ea35 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RpcManager 11:35:50,942 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@6218a556 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Activation 11:35:50,943 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@1b93bad3 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Transactions 11:35:50,943 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@5c1db2c4 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 11:35:50,943 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@45ac4330 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=LockManager 11:35:50,943 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@62397cc6 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache 11:35:50,943 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@647a1770 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 11:35:50,952 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@55c002a9 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Passivation 11:35:50,952 DEBUG [org.infinispan.jmx.JmxUtil] (testng) Object name infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 11:35:50,952 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@72d27ee2 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 11:35:50,952 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@5ba4f332 under infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Statistics 11:35:50,952 TRACE [org.infinispan.jmx.CacheJmxRegistration] (testng) ISPN000031: MBeans were successfully registered to the platform MBean server. 11:35:50,952 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (testng) starting distribution manager on NodeC-21874 11:35:50,952 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Starting StateTransferManager of cache dist on node NodeC-21874 11:35:50,952 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Node NodeC-21874 joining cache dist 11:35:50,952 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeC-21874, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=0fa68d1e-3f42-4ce4-9900-8b153048bf3d, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=SYNCHRONOUS, timeout=240000 11:35:50,952 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeC-21874, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=0fa68d1e-3f42-4ce4-9900-8b153048bf3d, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient NodeA-45995 with response mode GET_ALL 11:35:50,952 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeC-21874: invoking unicast RPC [req-id=604] on NodeA-45995 11:35:50,952 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #5, conn_id=0) 11:35:50,952 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=604, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:50,952 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (162 bytes (810.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:50,952 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (165 bytes) 11:35:50,952 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=89 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=604, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:50,952 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #5, conn_id=0) 11:35:50,952 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#5 11:35:50,952 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 604 11:35:50,954 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeC-21874, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=0fa68d1e-3f42-4ce4-9900-8b153048bf3d, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=NodeC-21874] 11:35:50,954 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:50,963 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Added joiner NodeC-21874 to cache dist with persistent uuid 0fa68d1e-3f42-4ce4-9900-8b153048bf3d: members = [NodeA-45995, NodeB-51742, NodeC-21874], joiners = [NodeC-21874] 11:35:50,979 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Queueing rebalance for cache dist with members [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,979 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Rebalancing consistent hash for cache dist, members are [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:50,982 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Updating cache dist topology for rebalance: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:50,983 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Cache dist topology updated: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]}, members = [NodeA-45995, NodeB-51742, NodeC-21874], joiners = [NodeC-21874] 11:35:50,987 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t6) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,987 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t6) Pending consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:50,987 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t6) Initialized rebalance confirmation collector 4@dist, initial list is [NodeA-45995, NodeC-21874, NodeB-51742] 11:35:50,988 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) ISPN000310: Starting cluster-wide rebalance for cache dist, topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:50,988 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) [Context=dist][Scope=NodeA-45995]ISPN100002: Started local rebalance 11:35:50,988 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} 11:35:50,988 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) Waiting on view 2 being accepted 11:35:50,988 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Updating local topology for cache dist: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:50,988 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Starting local rebalance for cache dist, topology = CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:50,988 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:50,988 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Pending consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:50,988 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t1) Installing new cache topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 134+122, NodeB-51742: 122+134, NodeC-21874: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} on cache dist 11:35:50,988 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=4, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 134+122, NodeB-51742: 122+134, NodeC-21874: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:50,988 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Start keeping track of keys for rebalance 11:35:50,988 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,988 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Tracking is disabled. Clear tracker: {} 11:35:50,988 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:50,988 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t1) Signalling topology 4 is installed 11:35:50,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:50,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) On cache dist we have: added segments: []; removed segments: [] 11:35:50,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Topology update processed, stateTransferTopologyId = 4, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} 11:35:50,989 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t1) Signalling transaction data received for topology 4 11:35:50,989 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Finished receiving of segments for cache dist for topology 4. 11:35:50,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Stop keeping track of changed keys for state transfer 11:35:50,989 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:50,988 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t6) dests=null, command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 11:35:50,989 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} to addresses null with response mode GET_NONE 11:35:50,989 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t6) NodeA-45995: sending NodeA-45995#4 11:35:50,989 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 11:35:50,994 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t6) NodeA-45995 used 7492 credits, 1992500 remaining 11:35:50,998 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, stableTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}}} for command CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeC-21874, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=0fa68d1e-3f42-4ce4-9900-8b153048bf3d, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} 11:35:50,998 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 604 to NodeC-21874 11:35:50,998 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeC-21874: #3, conn_id=2) 11:35:50,998 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=604, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:50,989 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (7543 bytes (37715.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:50,989 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Tracking is disabled. Clear tracker: {} 11:35:51,001 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:51,002 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,004 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Removing no longer owned entries for cache dist 11:35:51,004 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeA-45995, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} 11:35:51,005 DEBUG [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t6) ISPN000328: Finished local rebalance for cache dist on node NodeA-45995, topology id = 4 11:35:51,008 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (7546 bytes) 11:35:51,008 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (7546 bytes) 11:35:51,008 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=7492 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 11:35:51,008 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeB-51742) NodeB-51742: received NodeA-45995#4 11:35:51,008 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeA-45995#4 11:35:51,008 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,008 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=7492 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 11:35:51,008 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#4 11:35:51,008 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#4 11:35:51,008 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,008 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} [sender=NodeA-45995] 11:35:51,008 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} [sender=NodeA-45995] 11:35:51,009 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,009 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 7492 credits, 1992500 remaining 11:35:51,014 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t6) Waiting on view 2 being accepted 11:35:51,008 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,014 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeB-51742) NodeA-45995 used 7492 credits, 1992500 remaining 11:35:51,014 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t6) Updating local topology for cache dist: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,014 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t6) Starting local rebalance for cache dist, topology = CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,014 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t6) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:51,008 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (6484 bytes (32420.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,014 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t6) Pending consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,014 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t6) Installing new cache topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 134+122, NodeB-51742: 122+134, NodeC-21874: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} on cache dist 11:35:51,007 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t6) [Context=dist][Scope=NodeA-45995]ISPN100003: Finished local rebalance 11:35:51,014 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=4, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 134+122, NodeB-51742: 122+134, NodeC-21874: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,014 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Start keeping track of keys for rebalance 11:35:51,004 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Topology changed, recalculating minTopologyId 11:35:51,017 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Changing minimum topology ID from 3 to 4 11:35:51,014 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,018 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Tracking is disabled. Clear tracker: {} 11:35:51,018 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:51,018 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t6) Signalling topology 4 is installed 11:35:51,014 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-threadNodeA-p408-t6) Rebalance confirmation collector 4@dist received confirmation for NodeA-45995, remaining list is [NodeC-21874, NodeB-51742] 11:35:51,018 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:51,018 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) On cache dist we have: added segments: []; removed segments: [] 11:35:51,018 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Topology update processed, stateTransferTopologyId = 4, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} 11:35:51,018 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t6) Signalling transaction data received for topology 4 11:35:51,018 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Finished receiving of segments for cache dist for topology 4. 11:35:51,018 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Stop keeping track of changed keys for state transfer 11:35:51,018 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,014 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (6487 bytes) 11:35:51,022 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=6411 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=604, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,025 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #3, conn_id=2) 11:35:51,025 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#3 11:35:51,025 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, stableTopology=CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}}} , received=true, suspected=false 11:35:51,026 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) Waiting on view 2 being accepted 11:35:51,026 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating local topology for cache dist: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:51,026 TRACE [org.infinispan.topology.CacheTopology] (testng) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:51,018 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Tracking is disabled. Clear tracker: {} 11:35:51,027 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t6) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=0 11:35:51,027 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient NodeA-45995 with response mode GET_NONE 11:35:51,028 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t6) NodeB-51742 --> DATA(NodeA-45995: #14, conn_id=0) 11:35:51,028 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t6) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 11:35:51,028 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:51,028 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,028 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Removing no longer owned entries for cache dist 11:35:51,028 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Topology changed, recalculating minTopologyId 11:35:51,031 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,033 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (119 bytes) 11:35:51,033 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 11:35:51,033 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #14, conn_id=0) 11:35:51,033 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#14 11:35:51,033 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,033 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=4, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=NodeB-51742] 11:35:51,033 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,033 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) ISPN000328: Finished local rebalance for cache dist on node NodeB-51742, topology id = 4 11:35:51,033 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) [Context=dist][Scope=NodeB-51742]ISPN100003: Finished local rebalance 11:35:51,028 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Changing minimum topology ID from 3 to 4 11:35:51,026 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:51,040 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Received new topology for cache dist, isRebalance = false, isMember = false, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:51,040 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling topology 3 is installed 11:35:51,040 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Requesting cluster listeners of cache dist from node NodeA-45995 11:35:51,040 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeC-21874 invoking StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,040 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_CACHE_LISTENERS, topologyId=3, segments=null}, mode=SYNCHRONOUS, timeout=240000 11:35:51,040 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,040 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeC-21874: invoking unicast RPC [req-id=619] on NodeA-45995 11:35:51,040 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #6, conn_id=0) 11:35:51,040 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=619, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 11:35:51,040 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (90 bytes (450.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,040 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (93 bytes) 11:35:51,041 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=17 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=619, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 11:35:51,044 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #6, conn_id=0) 11:35:51,044 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#6 11:35:51,044 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 619 11:35:51,044 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} [sender=NodeC-21874] 11:35:51,044 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,044 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} 11:35:51,036 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t6) Rebalance confirmation collector 4@dist received confirmation for NodeB-51742, remaining list is [NodeC-21874] 11:35:51,047 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-threadNodeA-p406-t5) Request received to get cluster listeners currently registered 11:35:51,053 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-threadNodeA-p406-t5) Cluster listeners found [] 11:35:51,053 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} 11:35:51,053 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 619 to NodeC-21874 11:35:51,053 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeC-21874: #4, conn_id=2) 11:35:51,053 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=619, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,053 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,053 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (84 bytes) 11:35:51,053 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=619, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,053 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #4, conn_id=2) 11:35:51,053 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#4 11:35:51,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:51,053 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeC-21874) Response(s) to StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_CACHE_LISTENERS, topologyId=3, segments=null} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:51,054 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) On cache dist we have: added segments: [] 11:35:51,054 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 11:35:51,054 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling transaction data received for topology 3 11:35:51,054 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:51,054 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,054 DEBUG [org.infinispan.transaction.impl.TransactionTable] (testng) Topology changed, recalculating minTopologyId 11:35:51,054 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Changing minimum topology ID from -1 to 3 11:35:51,054 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating stable topology for cache dist: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:51,054 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) StateTransferManager of cache dist on node NodeC-21874 received initial topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:51,054 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=SYNCHRONOUS, timeout=240000 11:35:51,054 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,054 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeC-21874: invoking unicast RPC [req-id=626] on NodeA-45995 11:35:51,054 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #7, conn_id=0) 11:35:51,054 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=626, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 11:35:51,054 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (89 bytes (445.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t3) Waiting on view 2 being accepted 11:35:51,061 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t3) Updating local topology for cache dist: CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,067 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t3) Starting local rebalance for cache dist, topology = CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,067 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeC-p460-t3) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:51,067 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeC-p460-t3) Pending consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,067 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeC-p460-t3) Installing new cache topology CacheTopology{id=4, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 134+122, NodeB-51742: 122+134, NodeC-21874: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} on cache dist 11:35:51,067 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeC-p460-t3) This is the first topology 4 in which the local node is a member 11:35:51,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=4, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 134+122, NodeB-51742: 122+134, NodeC-21874: 0+256]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Start keeping track of keys for rebalance 11:35:51,068 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,068 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t3) Tracking is disabled. Clear tracker: {} 11:35:51,068 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t3) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:51,068 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t3) Signalling topology 4 is installed 11:35:51,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [] 11:35:51,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) On cache dist we have: added segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; removed segments: [] 11:35:51,068 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist 11:35:51,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Requesting transactions for segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] of cache dist from node NodeA-45995 11:35:51,068 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeC-p460-t3) NodeC-21874 invoking StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t3) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]}, mode=SYNCHRONOUS, timeout=240000 11:35:51,069 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeC-p460-t3) Replication task sending StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,059 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (92 bytes) 11:35:51,069 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=16 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=626, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 11:35:51,069 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #7, conn_id=0) 11:35:51,069 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#7 11:35:51,069 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 626 11:35:51,069 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeC-21874] 11:35:51,069 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,069 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:51,069 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 626 to NodeC-21874 11:35:51,069 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeC-21874: #5, conn_id=2) 11:35:51,075 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=626, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,075 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,076 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (81 bytes) 11:35:51,076 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=626, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,076 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #5, conn_id=2) 11:35:51,069 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeC-p460-t3) NodeC-21874: invoking unicast RPC [req-id=627] on NodeA-45995 11:35:51,080 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeC-p460-t3) NodeC-21874 --> DATA(NodeA-45995: #8, conn_id=0) 11:35:51,080 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeC-p460-t3) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=627, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 11:35:51,080 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (782 bytes (3910.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,080 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (785 bytes) 11:35:51,080 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=709 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=627, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 11:35:51,079 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#5 11:35:51,087 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:51,087 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Waiting for initial state transfer to finish for cache dist on NodeC-21874 11:35:51,080 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #8, conn_id=0) 11:35:51,093 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#8 11:35:51,093 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 627 11:35:51,104 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} [sender=NodeC-21874] 11:35:51,104 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,104 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} 11:35:51,104 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Received request for transactions from node NodeC-21874 for segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] of cache dist with topology id 4 11:35:51,104 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Found 0 transaction(s) to transfer 11:35:51,104 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} 11:35:51,104 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 627 to NodeC-21874 11:35:51,104 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeC-21874: #6, conn_id=2) 11:35:51,104 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=627, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,104 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,105 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (84 bytes) 11:35:51,105 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=627, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,105 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #6, conn_id=2) 11:35:51,105 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#6 11:35:51,105 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:51,105 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeC-21874) Response(s) to StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:51,107 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Applying 0 transactions for cache dist transferred from node NodeA-45995 11:35:51,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Requesting transactions for segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] of cache dist from node NodeB-51742 11:35:51,107 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeC-p460-t3) NodeC-21874 invoking StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,108 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t3) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]}, mode=SYNCHRONOUS, timeout=240000 11:35:51,108 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeC-p460-t3) Replication task sending StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} to single recipient NodeB-51742 with response mode GET_ALL 11:35:51,109 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeC-p460-t3) NodeC-21874: invoking unicast RPC [req-id=641] on NodeB-51742 11:35:51,111 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeC-p460-t3) NodeC-21874: created sender window for NodeB-51742 (conn-id=1) 11:35:51,112 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeC-p460-t3) NodeC-21874 --> DATA(NodeB-51742: #1, conn_id=1, first) 11:35:51,112 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeC-p460-t3) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=641, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:51,112 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (722 bytes (3610.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:51,112 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (725 bytes) 11:35:51,112 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) 127.0.0.1:8302: connecting to 127.0.0.1:8301 11:35:51,113 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (3 headers), size=649 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=641, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:51,118 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742 <-- DATA(NodeC-21874: #1, conn_id=1, first) 11:35:51,126 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742: created receiver window for NodeC-21874 at seqno=#1 for conn-id=1 11:35:51,126 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeC-21874#1 11:35:51,126 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 641 11:35:51,126 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} [sender=NodeC-21874] 11:35:51,126 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,126 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} 11:35:51,126 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Received request for transactions from node NodeC-21874 for segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] of cache dist with topology id 4 11:35:51,126 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Found 0 transaction(s) to transfer 11:35:51,126 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} 11:35:51,126 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 641 to NodeC-21874 11:35:51,135 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742: created sender window for NodeC-21874 (conn-id=1) 11:35:51,139 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeC-21874: #1, conn_id=1, first) 11:35:51,139 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeC-21874, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=641, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:51,139 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,139 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8302 (84 bytes) 11:35:51,140 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeB-51742 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=641, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:51,140 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeB-51742: #1, conn_id=1, first) 11:35:51,140 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: created receiver window for NodeB-51742 at seqno=#1 for conn-id=1 11:35:51,140 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeB-51742#1 11:35:51,140 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: sender=NodeB-51742value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:51,140 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeC-21874) Response(s) to StateRequestCommand{cache=dist, origin=NodeC-21874, type=GET_TRANSACTIONS, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} is {NodeB-51742=SuccessfulResponse{responseValue=[]} } 11:35:51,140 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Applying 0 transactions for cache dist transferred from node NodeB-51742 11:35:51,140 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Adding transfer from NodeA-45995 for segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] 11:35:51,140 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Adding transfer from NodeB-51742 for segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] 11:35:51,140 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeC-p473-t1) Requesting segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] of cache dist from node NodeA-45995 11:35:51,140 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Finished adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] of cache dist 11:35:51,140 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeC-p473-t1) NodeC-21874 invoking StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:51,140 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Topology update processed, stateTransferTopologyId = 4, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} 11:35:51,140 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t3) Signalling transaction data received for topology 4 11:35:51,140 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeC-p473-t1) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:51,140 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:51,140 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,140 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeC-p473-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} to addresses [NodeA-45995] with response mode GET_ALL 11:35:51,140 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Removing no longer owned entries for cache dist 11:35:51,144 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeC-p473-t1) NodeC-21874: invoking multicast RPC [req-id=650] 11:35:51,145 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeC-p473-t1) NodeC-21874 --> DATA(NodeA-45995: #9, conn_id=0) 11:35:51,145 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeC-p473-t1) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=650, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 11:35:51,143 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) Topology changed, recalculating minTopologyId 11:35:51,146 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) Changing minimum topology ID from 3 to 4 11:35:51,146 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (782 bytes (3910.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,146 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (785 bytes) 11:35:51,146 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=709 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=650, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 11:35:51,146 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #9, conn_id=0) 11:35:51,146 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#9 11:35:51,146 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 650 11:35:51,146 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} [sender=NodeC-21874] 11:35:51,146 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,146 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} 11:35:51,146 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Starting outbound transfer of segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] to node NodeC-21874 with topology id 4 for cache dist 11:35:51,146 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Adding outbound transfer of segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] to NodeC-21874 11:35:51,148 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} 11:35:51,148 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 650 to NodeC-21874 11:35:51,148 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeC-21874: #7, conn_id=2) 11:35:51,148 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=650, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,148 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,149 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (80 bytes) 11:35:51,149 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t3) Sending last chunk containing 0 cache entries from segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] of cache dist to node NodeC-21874 11:35:51,149 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t3) NodeA-45995 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=4} to recipient list [NodeC-21874] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,149 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=650, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,149 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #7, conn_id=2) 11:35:51,149 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#7 11:35:51,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t3) dests=[NodeC-21874], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=4}, mode=SYNCHRONOUS, timeout=240000 11:35:51,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: Responses{ NodeA-45995: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:51,149 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t3) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=4} to single recipient NodeC-21874 with response mode GET_ALL 11:35:51,149 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t3) NodeA-45995: invoking unicast RPC [req-id=654] on NodeC-21874 11:35:51,153 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t3) NodeA-45995 --> DATA(NodeC-21874: #8, conn_id=2) 11:35:51,153 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t3) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=654, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,149 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeC-21874) Response(s) to StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253]} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:51,153 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (1183 bytes (5915.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,153 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (1186 bytes) 11:35:51,154 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=1110 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=654, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:51,154 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #8, conn_id=2) 11:35:51,154 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeA-45995#8 11:35:51,154 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 654 11:35:51,154 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeC-21874) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=4} [sender=NodeA-45995] 11:35:51,154 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeC-21874) Checking if transaction data was received for topology 0, current topology is 4 11:35:51,155 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeC-p473-t1) Successfully requested segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] of cache dist from node NodeA-45995 11:35:51,155 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253], finishedSegments=[], unfinishedSegments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@38df83f3[Not completed], topologyId=4, timeout=240000, cacheName=dist} 11:35:51,161 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t4) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=4} 11:35:51,161 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Before applying the received state the data container of cache dist has 0 keys 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 0 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 0 of cache dist 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 1 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 1 of cache dist 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 6 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 7 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 3 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 3 of cache dist 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 2 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 2 of cache dist 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 7 of cache dist 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 6 of cache dist 11:35:51,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 10 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 10 of cache dist 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 19 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 13 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 19 of cache dist 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 13 of cache dist 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 23 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 23 of cache dist 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 25 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 24 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 24 of cache dist 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 18 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 18 of cache dist 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 17 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 17 of cache dist 11:35:51,166 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 16 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,166 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 16 of cache dist 11:35:51,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 25 of cache dist 11:35:51,167 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 31 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,167 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 31 of cache dist 11:35:51,167 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 32 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,167 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 32 of cache dist 11:35:51,167 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 33 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,167 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 34 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 34 of cache dist 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 43 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 39 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 39 of cache dist 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 27 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 43 of cache dist 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 45 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 45 of cache dist 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 46 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 40 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,167 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 33 of cache dist 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 40 of cache dist 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 46 of cache dist 11:35:51,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 44 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 44 of cache dist 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 50 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 50 of cache dist 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 52 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 52 of cache dist 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 53 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 53 of cache dist 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 54 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 54 of cache dist 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 56 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 27 of cache dist 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 51 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 51 of cache dist 11:35:51,186 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeC-21874) NodeC-21874 --> ACK(NodeA-45995: #8) 11:35:51,186 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeC-21874) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are UNICAST3: ACK, seqno=8, conn_id=2, ts=1, TP: [cluster_name=ISPN] 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 47 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 47 of cache dist 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 48 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 56 of cache dist 11:35:51,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 59 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 61 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 61 of cache dist 11:35:51,197 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeC-21874) NodeC-21874 --> ACK(NodeB-51742: #1) 11:35:51,197 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeC-21874) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are UNICAST3: ACK, seqno=1, conn_id=1, ts=2, TP: [cluster_name=ISPN] 11:35:51,197 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeB-51742, ISPN:NodeA-45995] 11:35:51,197 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (63 bytes) 11:35:51,197 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (63 bytes) 11:35:51,197 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=8, conn_id=2, ts=1, TP: [cluster_name=ISPN] 11:35:51,197 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- ACK(NodeC-21874: #8, conn-id=2, ts=1) 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 59 of cache dist 11:35:51,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 48 of cache dist 11:35:51,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 62 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 62 of cache dist 11:35:51,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 57 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 57 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 68 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 68 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 70 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 70 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 74 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 74 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 76 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 76 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 77 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 77 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 78 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 78 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 79 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 79 of cache dist 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 81 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 81 of cache dist 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 83 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 83 of cache dist 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 85 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 85 of cache dist 11:35:51,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 86 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 86 of cache dist 11:35:51,199 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=1, conn_id=1, ts=2, TP: [cluster_name=ISPN] 11:35:51,208 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeB-51742) NodeB-51742 <-- ACK(NodeC-21874: #1, conn-id=1, ts=2) 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 65 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 65 of cache dist 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 64 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,202 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 69 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 64 of cache dist 11:35:51,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 69 of cache dist 11:35:51,199 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 67 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,209 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 67 of cache dist 11:35:51,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 88 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 88 of cache dist 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 95 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 89 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 95 of cache dist 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 89 of cache dist 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 90 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 90 of cache dist 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 93 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 93 of cache dist 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 104 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,210 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 94 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,217 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 94 of cache dist 11:35:51,211 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 104 of cache dist 11:35:51,218 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 110 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,218 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 108 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,218 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 106 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,218 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 106 of cache dist 11:35:51,218 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 108 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 110 of cache dist 11:35:51,218 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 109 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 109 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 115 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 112 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 115 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 112 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 117 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 117 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 124 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 124 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 126 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 120 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 120 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 123 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 126 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 118 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 118 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 123 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 129 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 133 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 129 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 130 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 130 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 131 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 131 of cache dist 11:35:51,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 128 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 128 of cache dist 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 133 of cache dist 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 145 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 145 of cache dist 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 146 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 146 of cache dist 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 148 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 139 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 139 of cache dist 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 142 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 142 of cache dist 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 134 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 134 of cache dist 11:35:51,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 148 of cache dist 11:35:51,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 149 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 150 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 152 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 152 of cache dist 11:35:51,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 144 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,238 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 144 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 150 of cache dist 11:35:51,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 149 of cache dist 11:35:51,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 153 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 153 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 154 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 161 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 160 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 161 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 160 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 154 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 162 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 162 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 167 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 167 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 164 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 172 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 172 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 173 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 173 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 175 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 175 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 179 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 179 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 157 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 157 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 180 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 180 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 184 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 184 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 183 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 165 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 165 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 183 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 187 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 187 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 164 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 196 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 196 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 198 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 198 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 204 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 204 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 207 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 207 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 209 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 209 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 210 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 210 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 214 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 194 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 194 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 191 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 191 of cache dist 11:35:51,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 163 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 163 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 197 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 197 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 214 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 219 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 219 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 216 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 216 of cache dist 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 221 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 221 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 220 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,241 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 222 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 222 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 220 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 233 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 233 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 239 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 239 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 242 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 242 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 224 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 224 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 231 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 231 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 226 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 243 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 243 of cache dist 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Applying new state chunk for segment 248 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 245 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 245 of cache dist 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 246 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 246 of cache dist 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Finished applying chunk of segment 248 of cache dist 11:35:51,242 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 226 of cache dist 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 249 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 249 of cache dist 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 251 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 250 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 251 of cache dist 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 250 of cache dist 11:35:51,243 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 253 of cache dist from node NodeA-45995: received 0 cache entries 11:35:51,244 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 253 of cache dist 11:35:51,244 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeC-p473-t3) Finished receiving state for segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] of cache dist 11:35:51,244 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Inbound transfer finished: InboundTransferTask{segments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253], finishedSegments=[0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253], unfinishedSegments=[], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@38df83f3[Completed normally], topologyId=4, timeout=240000, cacheName=dist} 11:35:51,245 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Removing inbound transfers for segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] from source NodeA-45995 for cache dist 11:35:51,245 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeC-p473-t4) Requesting segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] of cache dist from node NodeB-51742 11:35:51,245 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeC-p473-t4) NodeC-21874 invoking StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:51,245 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeC-p473-t4) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:51,245 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeC-p473-t4) Replication task sending StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} to addresses [NodeB-51742] with response mode GET_ALL 11:35:51,245 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeC-p473-t4) NodeC-21874: invoking multicast RPC [req-id=674] 11:35:51,245 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeC-p473-t4) NodeC-21874 --> DATA(NodeB-51742: #2, conn_id=1) 11:35:51,245 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeC-p473-t4) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=674, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,246 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (722 bytes (3610.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:51,246 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (725 bytes) 11:35:51,246 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (3 headers), size=649 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=674, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,246 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742 <-- DATA(NodeC-21874: #2, conn_id=1) 11:35:51,246 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeC-21874#2 11:35:51,246 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 674 11:35:51,246 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} [sender=NodeC-21874] 11:35:51,246 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} 11:35:51,246 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Starting outbound transfer of segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] to node NodeC-21874 with topology id 4 for cache dist 11:35:51,246 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,246 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Adding outbound transfer of segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] to NodeC-21874 11:35:51,251 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} 11:35:51,251 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 674 to NodeC-21874 11:35:51,251 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeC-21874: #2, conn_id=1) 11:35:51,251 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeC-21874, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=674, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,251 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,251 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8302 (80 bytes) 11:35:51,251 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t1) Sending last chunk containing 0 cache entries from segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] of cache dist to node NodeC-21874 11:35:51,251 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeB-p417-t1) NodeB-51742 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=4} to recipient list [NodeC-21874] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,251 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t1) dests=[NodeC-21874], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=4}, mode=SYNCHRONOUS, timeout=240000 11:35:51,251 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t1) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=4} to single recipient NodeC-21874 with response mode GET_ALL 11:35:51,251 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeB-p417-t1) NodeB-51742: invoking unicast RPC [req-id=678] on NodeC-21874 11:35:51,251 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t1) NodeB-51742 --> DATA(NodeC-21874: #3, conn_id=1) 11:35:51,251 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) After applying the received state the data container of cache dist has 0 keys 11:35:51,251 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t4) Segments not received yet for cache dist: {NodeB-51742=[InboundTransferTask{segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255], finishedSegments=[], unfinishedSegments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4683aa6a[Not completed], topologyId=4, timeout=240000, cacheName=dist}]} 11:35:51,252 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t4) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=4} 11:35:51,252 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t4) sending rsp for 654 to NodeA-45995 11:35:51,252 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t4) NodeC-21874 --> DATA(NodeA-45995: #10, conn_id=0) 11:35:51,252 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t4) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=654, rsp_expected=true, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 11:35:51,252 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,252 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (78 bytes) 11:35:51,251 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t1) NodeB-51742: sending msg to NodeC-21874, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=678, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,252 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (1087 bytes (5435.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,252 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8302 (1090 bytes) 11:35:51,252 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=654, rsp_expected=true, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 11:35:51,252 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #10, conn_id=0) 11:35:51,252 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#10 11:35:51,259 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: sender=NodeC-21874, received=true, suspected=false 11:35:51,259 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=4} is {NodeC-21874=SuccessfulResponse{responseValue=null} } 11:35:51,259 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeB-51742 (3 headers), size=1014 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=678, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,259 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeB-51742: #3, conn_id=1) 11:35:51,259 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeB-51742#3 11:35:51,259 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t3) Outbound transfer of segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] of cache dist to node NodeC-21874 is complete 11:35:51,259 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeA-p408-t3) Removing completed outbound transfer of segments [0, 1, 2, 3, 6, 7, 10, 13, 16, 17, 18, 19, 23, 24, 25, 27, 31, 32, 33, 34, 39, 40, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 56, 57, 59, 61, 62, 64, 65, 67, 68, 69, 70, 74, 76, 77, 78, 79, 81, 83, 85, 86, 88, 89, 90, 93, 94, 95, 104, 106, 108, 109, 110, 112, 115, 117, 118, 120, 123, 124, 126, 128, 129, 130, 131, 133, 134, 139, 142, 144, 145, 146, 148, 149, 150, 152, 153, 154, 157, 160, 161, 162, 163, 164, 165, 167, 172, 173, 175, 179, 180, 183, 184, 187, 191, 194, 196, 197, 198, 204, 207, 209, 210, 214, 216, 219, 220, 221, 222, 224, 226, 231, 233, 239, 242, 243, 245, 246, 248, 249, 250, 251, 253] to NodeC-21874 for cache dist 11:35:51,259 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 678 11:35:51,259 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeB-51742 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=674, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,263 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874 <-- DATA(NodeB-51742: #2, conn_id=1) 11:35:51,263 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeB-51742#2 11:35:51,263 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeC-21874) Responses: Responses{ NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:51,263 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=4} [sender=NodeB-51742] 11:35:51,263 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeC-21874) Response(s) to StateRequestCommand{cache=dist, origin=NodeC-21874, type=START_STATE_TRANSFER, topologyId=4, segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255]} is {NodeB-51742=SuccessfulResponse{responseValue=null} } 11:35:51,263 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeC-21874) Checking if transaction data was received for topology 0, current topology is 4 11:35:51,263 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeC-p473-t4) Successfully requested segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] of cache dist from node NodeB-51742 11:35:51,263 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255], finishedSegments=[], unfinishedSegments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4683aa6a[Not completed], topologyId=4, timeout=240000, cacheName=dist} 11:35:51,263 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t5) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=4} 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Before applying the received state the data container of cache dist has 0 keys 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 4 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 11 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 9 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 9 of cache dist 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 5 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,266 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 5 of cache dist 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 11 of cache dist 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 8 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,263 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 4 of cache dist 11:35:51,266 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 8 of cache dist 11:35:51,266 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 12 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,266 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 12 of cache dist 11:35:51,266 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 14 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,269 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 14 of cache dist 11:35:51,266 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 15 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 15 of cache dist 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 28 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 28 of cache dist 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 26 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 21 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,273 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 21 of cache dist 11:35:51,273 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeC-21874: #10) 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 26 of cache dist 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 29 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 29 of cache dist 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 35 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 35 of cache dist 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 36 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 22 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,270 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 20 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 20 of cache dist 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 22 of cache dist 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 36 of cache dist 11:35:51,276 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 30 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,273 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are UNICAST3: ACK, seqno=10, ts=4, TP: [cluster_name=ISPN] 11:35:51,279 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 38 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,279 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 38 of cache dist 11:35:51,279 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeB-51742: #14) 11:35:51,279 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 37 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,279 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 37 of cache dist 11:35:51,279 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are UNICAST3: ACK, seqno=14, ts=5, TP: [cluster_name=ISPN] 11:35:51,280 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeB-51742] 11:35:51,280 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (63 bytes) 11:35:51,280 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (63 bytes) 11:35:51,280 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=14, ts=5, TP: [cluster_name=ISPN] 11:35:51,280 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742 <-- ACK(NodeA-45995: #14, conn-id=0, ts=5) 11:35:51,279 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 30 of cache dist 11:35:51,279 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 41 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 41 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 58 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 58 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 60 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 60 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 63 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 63 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 66 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 66 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 42 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 71 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 42 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 71 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 49 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 49 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 55 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 55 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 72 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 72 of cache dist 11:35:51,281 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 73 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 73 of cache dist 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 87 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 82 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 82 of cache dist 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 80 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 80 of cache dist 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 84 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 84 of cache dist 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 75 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 75 of cache dist 11:35:51,283 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, ts=4, TP: [cluster_name=ISPN] 11:35:51,287 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeC-21874) NodeC-21874 <-- ACK(NodeA-45995: #10, conn-id=0, ts=4) 11:35:51,287 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 87 of cache dist 11:35:51,291 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 97 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,291 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 97 of cache dist 11:35:51,292 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 92 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,292 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 92 of cache dist 11:35:51,291 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 96 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,291 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 98 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,292 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 91 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 98 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 101 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 100 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 101 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 102 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 102 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 103 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 103 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 100 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 99 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,312 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 99 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 96 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 91 of cache dist 11:35:51,306 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 105 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,315 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 105 of cache dist 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 107 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 116 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 114 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 114 of cache dist 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 116 of cache dist 11:35:51,321 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 121 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,321 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 121 of cache dist 11:35:51,321 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 122 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 122 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 125 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 125 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 127 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 127 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 132 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 132 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 135 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 135 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 136 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 136 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 137 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 137 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 138 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 138 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 140 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 140 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 119 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 119 of cache dist 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 107 of cache dist 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 113 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 113 of cache dist 11:35:51,322 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 141 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 141 of cache dist 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 155 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 147 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 147 of cache dist 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 143 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 143 of cache dist 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 151 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 151 of cache dist 11:35:51,318 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 111 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 111 of cache dist 11:35:51,330 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 155 of cache dist 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 156 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 156 of cache dist 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 158 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 166 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 159 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 166 of cache dist 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 159 of cache dist 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 158 of cache dist 11:35:51,331 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 168 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,345 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 168 of cache dist 11:35:51,345 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 176 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,345 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 171 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 170 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 170 of cache dist 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 169 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 169 of cache dist 11:35:51,345 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 171 of cache dist 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 174 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 174 of cache dist 11:35:51,345 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 176 of cache dist 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 182 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 182 of cache dist 11:35:51,346 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 185 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 185 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 186 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 186 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 188 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 188 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 189 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 189 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 190 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 190 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 192 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 192 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 193 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 193 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 195 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 195 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 181 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 181 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 178 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 178 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 177 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 177 of cache dist 11:35:51,347 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 199 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,348 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 199 of cache dist 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 203 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 203 of cache dist 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 205 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 202 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 202 of cache dist 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 201 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 201 of cache dist 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 200 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 200 of cache dist 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 205 of cache dist 11:35:51,349 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 213 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 213 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 215 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 215 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 217 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 217 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 218 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 218 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 223 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 223 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 225 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 225 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 227 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 227 of cache dist 11:35:51,354 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 212 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 212 of cache dist 11:35:51,352 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 211 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,352 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 208 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,361 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 208 of cache dist 11:35:51,352 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 206 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,361 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 206 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 211 of cache dist 11:35:51,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 228 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 228 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 235 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 235 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 236 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 236 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 237 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 237 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 238 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 238 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 240 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 240 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 241 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 241 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 244 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 244 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 247 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 247 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 252 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 252 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 254 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 254 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Applying new state chunk for segment 255 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Applying new state chunk for segment 230 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Applying new state chunk for segment 232 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t1) Finished applying chunk of segment 232 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Applying new state chunk for segment 229 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t4) Finished applying chunk of segment 229 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Applying new state chunk for segment 234 of cache dist from node NodeB-51742: received 0 cache entries 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t2) Finished applying chunk of segment 234 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeC-p473-t3) Finished applying chunk of segment 230 of cache dist 11:35:51,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished applying chunk of segment 255 of cache dist 11:35:51,371 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (remote-threadNodeC-p458-t5) Finished receiving state for segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] of cache dist 11:35:51,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Inbound transfer finished: InboundTransferTask{segments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255], finishedSegments=[4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255], unfinishedSegments=[], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4683aa6a[Completed normally], topologyId=4, timeout=240000, cacheName=dist} 11:35:51,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Removing inbound transfers for segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] from source NodeB-51742 for cache dist 11:35:51,371 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Finished receiving of segments for cache dist for topology 4. 11:35:51,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Stop keeping track of changed keys for state transfer 11:35:51,371 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeC-p458-t5) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,371 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeC-p458-t5) Tracking is disabled. Clear tracker: {} 11:35:51,371 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeC-p458-t5) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeC-21874, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=0 11:35:51,371 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeC-21874, joinInfo=null, topologyId=4, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} to single recipient NodeA-45995 with response mode GET_NONE 11:35:51,372 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t5) NodeC-21874 --> DATA(NodeA-45995: #11, conn_id=0) 11:35:51,372 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t5) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 11:35:51,372 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,372 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (119 bytes) 11:35:51,376 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 11:35:51,380 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #11, conn_id=0) 11:35:51,380 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#11 11:35:51,380 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,380 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeC-21874, joinInfo=null, topologyId=4, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=2} [sender=NodeC-21874] 11:35:51,380 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) After applying the received state the data container of cache dist has 0 keys 11:35:51,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeC-p458-t5) Segments not received yet for cache dist: {} 11:35:51,393 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t5) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=4} 11:35:51,393 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t5) sending rsp for 678 to NodeB-51742 11:35:51,393 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t5) NodeC-21874 --> DATA(NodeB-51742: #3, conn_id=1) 11:35:51,393 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t5) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=678, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,393 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:51,380 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000328: Finished local rebalance for cache dist on node NodeC-21874, topology id = 4 11:35:51,393 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) [Context=dist][Scope=NodeC-21874]ISPN100003: Finished local rebalance 11:35:51,394 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Rebalance confirmation collector 4@dist received confirmation for NodeC-21874, remaining list is [] 11:35:51,394 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000336: Finished cluster-wide rebalance for cache dist, topology id = 4 11:35:51,394 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Cache dist topology updated: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]}, members = [NodeA-45995, NodeB-51742, NodeC-21874], joiners = [] 11:35:51,395 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t5) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,393 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (78 bytes) 11:35:51,395 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=678, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:51,395 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742 <-- DATA(NodeC-21874: #3, conn_id=1) 11:35:51,396 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeC-21874#3 11:35:51,395 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t5) Updating cluster-wide current topology for cache dist, topology = CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]}, availability mode = AVAILABLE 11:35:51,399 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t5) dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 11:35:51,399 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} to addresses null with response mode GET_NONE 11:35:51,400 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t5) NodeA-45995: sending NodeA-45995#5 11:35:51,400 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 11:35:51,400 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t5) NodeA-45995 used 4354 credits, 1988146 remaining 11:35:51,400 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Updating stable topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,400 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t5) Updating cluster-wide stable topology for cache dist, topology = CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,400 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t5) dests=null, command=CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2}, mode=ASYNCHRONOUS, timeout=240000 11:35:51,400 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} to addresses null with response mode GET_NONE 11:35:51,400 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t5) NodeA-45995: sending NodeA-45995#6 11:35:51,400 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 11:35:51,400 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t5) NodeA-45995 used 4353 credits, 1983793 remaining 11:35:51,400 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} 11:35:51,400 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t4) Waiting on view 2 being accepted 11:35:51,400 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t4) Updating local topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,400 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t4) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,400 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t4) Installing new cache topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} on cache dist 11:35:51,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,401 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t4) Signalling topology 5 is installed 11:35:51,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:51,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) On cache dist we have: added segments: []; removed segments: [] 11:35:51,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Topology update processed, stateTransferTopologyId = 4, startRebalance = false, pending CH = null 11:35:51,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Stop keeping track of changed keys for state transfer 11:35:51,401 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 2 msgs (8809 bytes (44045.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:51,401 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (8786 bytes) 11:35:51,404 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (8786 bytes) 11:35:51,404 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=4354 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 11:35:51,404 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#5 11:35:51,404 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#5 11:35:51,404 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=4354 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 11:35:51,404 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,404 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: received NodeA-45995#5 11:35:51,404 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#5 11:35:51,401 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t4) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,404 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,404 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t4) Tracking is disabled. Clear tracker: {} 11:35:51,405 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} [sender=NodeA-45995] 11:35:51,405 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} with new topology 5 and was pre false 11:35:51,405 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t4) No change listeners present! 11:35:51,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Unlock State Transfer in Progress for topology ID 5 11:35:51,405 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t4) Signalling transaction data received for topology 5 11:35:51,405 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:51,405 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,405 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Removing no longer owned entries for cache dist 11:35:51,400 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} 11:35:51,407 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=4353 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 11:35:51,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#6 11:35:51,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#6 11:35:51,407 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,399 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeB-51742) NodeB-51742 --> ACK(NodeC-21874: #3) 11:35:51,407 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeB-51742) NodeB-51742: sending msg to NodeC-21874, src=NodeB-51742, headers are UNICAST3: ACK, seqno=3, conn_id=1, ts=3, TP: [cluster_name=ISPN] 11:35:51,407 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t4) Waiting on view 2 being accepted 11:35:51,407 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,408 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8302 (63 bytes) 11:35:51,408 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t4) Updating local topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,408 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeC-p460-t4) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,408 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeC-p460-t4) Installing new cache topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} on cache dist 11:35:51,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t4) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,408 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t4) Signalling topology 5 is installed 11:35:51,408 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=3, conn_id=1, ts=3, TP: [cluster_name=ISPN] 11:35:51,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t4) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:51,396 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeB-51742) Responses: sender=NodeC-21874, received=true, suspected=false 11:35:51,408 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeB-51742) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=4} is {NodeC-21874=SuccessfulResponse{responseValue=null} } 11:35:51,409 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t1) Outbound transfer of segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] of cache dist to node NodeC-21874 is complete 11:35:51,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t4) On cache dist we have: added segments: []; removed segments: [] 11:35:51,408 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeC-21874) NodeC-21874 <-- ACK(NodeB-51742: #3, conn-id=1, ts=3) 11:35:51,407 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} [sender=NodeA-45995] 11:35:51,412 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,412 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t2) Updating stable topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,407 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,412 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 4354 credits, 1988146 remaining 11:35:51,405 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Topology changed, recalculating minTopologyId 11:35:51,416 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Changing minimum topology ID from 4 to 5 11:35:51,416 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t4) Updating stable topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,405 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} [sender=NodeA-45995] 11:35:51,404 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=4353 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 11:35:51,416 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,416 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: received NodeA-45995#6 11:35:51,416 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeB-51742) NodeA-45995 used 4354 credits, 1988146 remaining 11:35:51,416 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t3) Waiting on view 2 being accepted 11:35:51,427 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t3) Updating local topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,416 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeA-45995#6 11:35:51,427 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t3) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,427 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t3) Installing new cache topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} on cache dist 11:35:51,414 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 4353 credits, 1988147 remaining 11:35:51,430 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t4) Topology update processed, stateTransferTopologyId = 4, startRebalance = false, pending CH = null 11:35:51,430 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t4) Stop keeping track of changed keys for state transfer 11:35:51,430 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t4) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,430 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t4) Tracking is disabled. Clear tracker: {} 11:35:51,431 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeC-p460-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} with new topology 5 and was pre false 11:35:51,431 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeC-p460-t4) No change listeners present! 11:35:51,431 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t4) Unlock State Transfer in Progress for topology ID 5 11:35:51,431 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t4) Signalling transaction data received for topology 5 11:35:51,431 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t4) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:51,431 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t4) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,434 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeB-p417-t1) Removing completed outbound transfer of segments [4, 5, 8, 9, 11, 12, 14, 15, 20, 21, 22, 26, 28, 29, 30, 35, 36, 37, 38, 41, 42, 49, 55, 58, 60, 63, 66, 71, 72, 73, 75, 80, 82, 84, 87, 91, 92, 96, 97, 98, 99, 100, 101, 102, 103, 105, 107, 111, 113, 114, 116, 119, 121, 122, 125, 127, 132, 135, 136, 137, 138, 140, 141, 143, 147, 151, 155, 156, 158, 159, 166, 168, 169, 170, 171, 174, 176, 177, 178, 181, 182, 185, 186, 188, 189, 190, 192, 193, 195, 199, 200, 201, 202, 203, 205, 206, 208, 211, 212, 213, 215, 217, 218, 223, 225, 227, 228, 229, 230, 232, 234, 235, 236, 237, 238, 240, 241, 244, 247, 252, 254, 255] to NodeC-21874 for cache dist 11:35:51,433 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t4) Removing no longer owned entries for cache dist 11:35:51,437 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t4) Topology changed, recalculating minTopologyId 11:35:51,437 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t4) Changing minimum topology ID from 4 to 5 11:35:51,437 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeC-p460-t4) Initial state transfer complete for cache dist on node NodeC-21874 11:35:51,437 DEBUG [org.infinispan.cache.impl.CacheImpl] (testng) Started cache dist on NodeC-21874 11:35:51,427 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,437 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling topology 5 is installed 11:35:51,437 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,437 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:51,437 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: added segments: []; removed segments: [] 11:35:51,437 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Topology update processed, stateTransferTopologyId = 4, startRebalance = false, pending CH = null 11:35:51,437 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Stop keeping track of changed keys for state transfer 11:35:51,437 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], throwable=null, viewId=2} [sender=NodeA-45995] 11:35:51,438 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,437 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Closing latch for cache dist 11:35:51,438 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t5) Updating stable topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,443 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: ModuleLifecycle 11:35:51,444 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: CoreTestMetadataFileFinder 11:35:51,438 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,444 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t3) Tracking is disabled. Clear tracker: {} 11:35:51,444 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t3) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} with new topology 5 and was pre false 11:35:51,445 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t3) No change listeners present! 11:35:51,445 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Unlock State Transfer in Progress for topology ID 5 11:35:51,445 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling transaction data received for topology 5 11:35:51,445 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:51,445 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,445 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Removing no longer owned entries for cache dist 11:35:51,445 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Topology changed, recalculating minTopologyId 11:35:51,445 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Changing minimum topology ID from 4 to 5 11:35:51,447 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) Loading service impl: TestModuleCommandExtensions 11:35:51,447 DEBUG [org.infinispan.util.ModuleProperties] (testng) Loading module command extension SPI class: org.infinispan.remoting.rpc.TestModuleCommandExtensions@260e0ad6 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterAvailability [r=true,w=false,is=false,type=java.lang.String] 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String cancelPushState 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String bringSiteOnline 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String takeSiteOffline 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String pushState 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:51,447 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute physicalAddresses [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute nodeAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute runningCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinatorAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheConfigurationNames [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterMembers [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterName [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute name [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterSize [r=true,w=false,is=false,type=int] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute globalConfigurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinator [r=true,w=false,is=true,type=boolean] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute createdCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheManagerStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheNames [r=true,w=false,is=false,type=java.lang.String] 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:51,448 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:51,448 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@59c11d5 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=LocalTopologyManager 11:35:51,448 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@614dc386 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=GlobalXSiteAdminOperations 11:35:51,448 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@28e0334a under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=CacheContainerStats 11:35:51,448 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@26f63251 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=CacheManager 11:35:51,440 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeC-21874) NodeA-45995 used 4353 credits, 1983793 remaining 11:35:51,450 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000078: Starting JGroups channel ISPN 11:35:51,461 DEBUG [org.jgroups.stack.Configurator] (testng) set property TCP_NIO2.diagnostics_addr to default value /224.0.75.75 11:35:51,478 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:51,494 TRACE [org.jgroups.protocols.UNICAST3] (testng) null: set max_xmit_req_size from 0 to 247600 11:35:51,498 TRACE [org.jgroups.blocks.MessageDispatcher] (testng) setting local_addr (null) to NodeD-43076 11:35:51,498 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeD-43076: stable task started 11:35:51,498 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Discovery.stopped=false 11:35:51,501 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) address=NodeD-43076, cluster=ISPN, physical address=127.0.0.1:8303 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Added discovery for NodeD-43076. Registered discoveries: {NodeD-43076=TEST_PING@NodeD-43076, NodeA-45995=TEST_PING@NodeA-45995, NodeC-21874=TEST_PING@NodeC-21874, NodeB-51742=TEST_PING@NodeB-51742} 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Skipping sending discovery to self 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeA-45995 with physical address 127.0.0.1:8300 in TEST_PING@NodeD-43076 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeD-43076 with physical address 127.0.0.1:8303 in TEST_PING@NodeA-45995 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Returning ping rsp: NodeA-45995, name=NodeA-45995, addr=127.0.0.1:8300, coord 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeC-21874 with physical address 127.0.0.1:8302 in TEST_PING@NodeD-43076 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeD-43076 with physical address 127.0.0.1:8303 in TEST_PING@NodeC-21874 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Returning ping rsp: NodeC-21874, name=NodeC-21874, addr=127.0.0.1:8302, server 11:35:51,502 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeB-51742 with physical address 127.0.0.1:8301 in TEST_PING@NodeD-43076 11:35:51,507 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Map NodeD-43076 with physical address 127.0.0.1:8303 in TEST_PING@NodeB-51742 11:35:51,507 TRACE [org.infinispan.test.fwk.TEST_PING] (testng) Returning ping rsp: NodeB-51742, name=NodeB-51742, addr=127.0.0.1:8301, server 11:35:51,507 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeD-43076: discovery took 5 ms, members: 3 rsps (1 coords) [done] 11:35:51,508 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeD-43076: sending JOIN(NodeD-43076) to NodeA-45995 11:35:51,508 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076: created sender window for NodeA-45995 (conn-id=0) 11:35:51,508 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #1, conn_id=0, first) 11:35:51,508 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are GMS: GmsHeader[JOIN_REQ]: mbr=NodeD-43076, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:51,508 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,508 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (86 bytes) 11:35:51,517 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) 127.0.0.1:8303: connecting to 127.0.0.1:8300 11:35:51,547 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_REQ]: mbr=NodeD-43076, UNICAST3: DATA, seqno=1, first, TP: [cluster_name=ISPN] 11:35:51,560 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #1, conn_id=0, first) 11:35:51,564 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: created receiver window for NodeD-43076 at seqno=#1 for conn-id=0 11:35:51,564 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeD-43076#1 11:35:51,564 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: joiners=[NodeD-43076], suspected=[], leaving=[], new view: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,564 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) suspending message garbage collection 11:35:51,564 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) NodeA-45995: resume task started, max_suspend_time=33000 11:35:51,564 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: mcasting view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] (4 mbrs) 11:35:51,564 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (ViewHandler,NodeA-45995) NodeA-45995: sending NodeA-45995#7 11:35:51,564 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to null, src=NodeA-45995, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 11:35:51,564 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: looping back message [dst: , src: NodeA-45995 (3 headers), size=61 bytes] 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 11:35:51,565 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: received NodeA-45995#7 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (112 bytes (560.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:51,565 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: delivering NodeA-45995#7-7 (1 messages) 11:35:51,565 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: received delta view [NodeA-45995|3], ref-view=[NodeA-45995|2], joined=[NodeD-43076] 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (115 bytes) 11:35:51,565 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: installing view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (115 bytes) 11:35:51,565 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1], NodeD-43076: [-1] 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (115 bytes) 11:35:51,565 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeA-45995) Handle view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,565 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeA-45995) new membership: [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,565 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,565 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) New view accepted: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 11:35:51,565 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) Joined: [NodeD-43076], Left: [] 11:35:51,565 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,565 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Received new cluster view: 3, isCoordinator = true, old status = COORDINATOR 11:35:51,565 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Updating cluster members for all the caches. New list is [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,565 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 11:35:51,565 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t1) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to addresses null with response mode GET_ALL 11:35:51,565 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t1) NodeA-45995: invoking multicast RPC [req-id=718] 11:35:51,565 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-threadNodeA-p408-t1) NodeA-45995: sending NodeA-45995#8 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t1) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=718, rsp_expected=true, NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 11:35:51,565 TRACE [org.jgroups.protocols.MFC] (transport-threadNodeA-p408-t1) NodeA-45995 used 8 credits, 1983785 remaining 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 11:35:51,565 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeD-43076) NodeD-43076: message NodeA-45995::7 was added to queue (not yet server) 11:35:51,566 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:51,566 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (64 bytes) 11:35:51,566 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (64 bytes) 11:35:51,566 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (64 bytes) 11:35:51,566 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=718, rsp_expected=true, NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 11:35:51,566 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#8 11:35:51,566 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#8 11:35:51,566 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 718 11:35:51,566 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:51,566 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=718, rsp_expected=true, NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 11:35:51,566 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: received NodeA-45995#8 11:35:51,566 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:51,565 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeA-45995) ISPN100000: Node NodeD-43076 joined the cluster 11:35:51,565 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: received NodeA-45995#7 11:35:51,567 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#7-7 (1 messages) 11:35:51,565 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 11:35:51,567 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeC-21874) NodeC-21874: received delta view [NodeA-45995|3], ref-view=[NodeA-45995|2], joined=[NodeD-43076] 11:35:51,567 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=718, rsp_expected=true, NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 11:35:51,567 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: message NodeA-45995::8 was added to queue (not yet server) 11:35:51,570 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeC-21874) NodeC-21874: installing view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,567 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: received NodeA-45995#7 11:35:51,586 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#7-7 (1 messages) 11:35:51,586 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: received delta view [NodeA-45995|3], ref-view=[NodeA-45995|2], joined=[NodeD-43076] 11:35:51,586 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: installing view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,587 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeB-51742) NodeB-51742: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1], NodeD-43076: [-1] 11:35:51,566 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 718 to NodeA-45995 11:35:51,587 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeA-45995: #15, conn_id=0) 11:35:51,587 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,587 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,566 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeA-45995#8 11:35:51,587 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 718 11:35:51,587 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:51,587 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,566 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,587 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:51,587 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 8 credits, 1983785 remaining 11:35:51,587 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 718 to NodeA-45995 11:35:51,592 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeA-45995: #12, conn_id=0) 11:35:51,587 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeC-21874) NodeA-45995 used 8 credits, 1983785 remaining 11:35:51,587 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=718, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 11:35:51,587 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeA-45995, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844429225099264 11:35:51,594 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,587 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeB-51742) Handle view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,594 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeB-51742) new membership: [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,596 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,596 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) New view accepted: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,596 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) Joined: [NodeD-43076], Left: [] 11:35:51,596 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,596 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeB-p417-t4) Received new cluster view: 3, isCoordinator = false, old status = REGULAR_MEMBER 11:35:51,594 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (81 bytes) 11:35:51,594 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeA-45995, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844429225099264 11:35:51,602 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=718, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 11:35:51,602 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995 --> DATA(NodeA-45995: #3, conn_id=0) 11:35:51,602 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #15, conn_id=0) 11:35:51,602 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: sending msg to NodeA-45995, src=NodeA-45995, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:51,602 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: looping back message [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 11:35:51,602 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:51,602 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- DATA(NodeA-45995: #3, conn_id=0) 11:35:51,594 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeC-21874) NodeC-21874: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1], NodeD-43076: [-1] 11:35:51,602 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeC-21874) Handle view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,594 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=718, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 11:35:51,602 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeC-21874) new membership: [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,602 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,602 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeC-21874) New view accepted: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,602 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeC-21874) Joined: [NodeD-43076], Left: [] 11:35:51,602 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeC-21874) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,602 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeC-p460-t6) Received new cluster view: 3, isCoordinator = false, old status = REGULAR_MEMBER 11:35:51,602 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeC-21874) ISPN100000: Node NodeD-43076 joined the cluster 11:35:51,602 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeC-21874) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeC-21874, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844437815033856 11:35:51,602 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeC-21874) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeC-21874, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844437815033856 11:35:51,602 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeC-p459-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,602 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeC-p459-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,602 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,602 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#15 11:35:51,597 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeB-51742) ISPN100000: Node NodeD-43076 joined the cluster 11:35:51,623 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeB-51742, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844433520066560 11:35:51,623 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeB-51742, viewId=3, subgroupsMerged=null, mergeView=false} and result was 844433520066560 11:35:51,624 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,624 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,624 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742 --> DATA(NodeA-45995: #16, conn_id=0) 11:35:51,624 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 11:35:51,624 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,624 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (70 bytes) 11:35:51,624 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 11:35:51,624 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #16, conn_id=0) 11:35:51,624 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#16 11:35:51,617 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeC-21874) NodeC-21874 --> DATA(NodeA-45995: #13, conn_id=0) 11:35:51,625 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeC-21874) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 11:35:51,610 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995: delivering NodeA-45995#3 11:35:51,626 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (81 bytes) 11:35:51,626 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,626 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (70 bytes) 11:35:51,626 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=718, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 11:35:51,626 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #12, conn_id=0) 11:35:51,626 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#12 11:35:51,627 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 11:35:51,627 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #13, conn_id=0) 11:35:51,627 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeC-21874#13 11:35:51,631 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (3) from members for view [NodeA-45995|3] 11:35:51,631 TRACE [org.jgroups.protocols.UNICAST3] (ViewHandler,NodeA-45995) NodeA-45995: created sender window for NodeD-43076 (conn-id=3) 11:35:51,631 TRACE [org.jgroups.protocols.UNICAST3] (ViewHandler,NodeA-45995) NodeA-45995 --> DATA(NodeD-43076: #1, conn_id=3, first) 11:35:51,631 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=3, first, TP: [cluster_name=ISPN] 11:35:51,631 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (170 bytes (850.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,631 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (173 bytes) 11:35:51,634 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=99 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[JOIN_RSP], UNICAST3: DATA, seqno=1, conn_id=3, first, TP: [cluster_name=ISPN] 11:35:51,634 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #1, conn_id=3, first) 11:35:51,634 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeD-43076) NodeD-43076: created receiver window for NodeA-45995 at seqno=#1 for conn-id=3 11:35:51,634 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#1 11:35:51,635 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (testng) [NodeD-43076 setDigest()] new digest: NodeA-45995: [6 (6)], NodeB-51742: [0 (0)], NodeC-21874: [0 (0)], NodeD-43076: [0 (0)] resulting digest: NodeA-45995: [6 (6)], NodeB-51742: [0 (0)], NodeC-21874: [0 (0)], NodeD-43076: [0 (0)] 11:35:51,641 DEBUG [org.jgroups.protocols.pbcast.GMS] (testng) NodeD-43076: installing view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,642 TRACE [org.jgroups.protocols.pbcast.STABLE] (testng) NodeD-43076: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1], NodeD-43076: [-1] 11:35:51,642 TRACE [org.jgroups.protocols.tom.TOA] (testng) Handle view [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,642 TRACE [org.jgroups.protocols.MFC] (testng) new membership: [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,642 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (testng) Added a new task directly: 0 task(s) are waiting 11:35:51,642 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) New view accepted: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,642 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|3] (4) [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,642 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (testng) NodeD-43076: flushing become_server_queue (2 elements) 11:35:51,642 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #2, conn_id=0) 11:35:51,642 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeD-43076) NodeD-43076: received NodeA-45995#7 11:35:51,642 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:51,642 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#7-7 (1 messages) 11:35:51,642 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000079: Channel ISPN local address is NodeD-43076, physical addresses are [127.0.0.1:8303] 11:35:51,643 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: received NodeA-45995#8 11:35:51,643 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#8 11:35:51,643 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 718 11:35:51,643 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:51,643 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,643 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (70 bytes) 11:35:51,643 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=2, TP: [cluster_name=ISPN] 11:35:51,643 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #2, conn_id=0) 11:35:51,643 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeD-p532-t1) Received new cluster view: 3, isCoordinator = false, old status = INITIALIZING 11:35:51,643 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:51,643 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeD-43076) NodeA-45995 used 8 credits, 1999992 remaining 11:35:51,643 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeD-43076#2 11:35:51,651 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (1) from joiners for view [NodeA-45995|3] 11:35:51,643 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=24000 11:35:51,651 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,651 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeD-43076: invoking unicast RPC [req-id=744] on NodeA-45995 11:35:51,651 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #3, conn_id=0) 11:35:51,651 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=744, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:51,651 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,652 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (84 bytes) 11:35:51,652 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=744, rsp_expected=true, UNICAST3: DATA, seqno=3, TP: [cluster_name=ISPN] 11:35:51,652 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #3, conn_id=0) 11:35:51,652 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#3 11:35:51,652 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 744 11:35:51,652 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeD-43076] 11:35:51,652 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,652 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:51,651 TRACE [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1], NodeD-43076: [-1] 11:35:51,653 DEBUG [org.jgroups.protocols.pbcast.STABLE] (ViewHandler,NodeA-45995) resuming message garbage collection 11:35:51,658 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 744 to NodeD-43076 11:35:51,658 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #2, conn_id=3) 11:35:51,658 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=744, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,658 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,658 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (81 bytes) 11:35:51,661 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=744, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,662 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #2, conn_id=3) 11:35:51,662 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#2 11:35:51,663 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:51,663 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Starting LocalTopologyManager on NodeD-43076 11:35:51,663 DEBUG [org.infinispan.manager.DefaultCacheManager] (testng) Started cache manager ISPN on NodeD 11:35:51,663 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) About to wire and start cache dist 11:35:51,664 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t2) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:51,664 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t2) sending rsp for 718 to NodeA-45995 11:35:51,664 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t2) NodeD-43076 --> DATA(NodeA-45995: #4, conn_id=0) 11:35:51,664 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t2) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=718, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:51,664 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,664 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (81 bytes) 11:35:51,667 INFO [org.infinispan.transaction.lookup.JBossStandaloneJTAManagerLookup] (testng) ISPN000107: Retrieving transaction manager Transaction: unknown 11:35:51,669 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=718, rsp_expected=true, UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:51,669 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #4, conn_id=0) 11:35:51,669 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#4 11:35:51,669 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: Responses{ NodeD-43076: sender=NodeD-43076value=SuccessfulResponse{responseValue=true} , received=true, suspected=false NodeC-21874: sender=NodeC-21874value=SuccessfulResponse{responseValue=true} , received=true, suspected=false NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=true} , received=true, suspected=false} 11:35:51,669 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t1) Cluster members updated for cache dist, no abrupt leavers detected: cache members = [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076]. Existing members = [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:51,669 TRACE [org.infinispan.partitionhandling.impl.PreferAvailabilityStrategy] (transport-threadNodeA-p408-t1) Cache dist did not lose any members, skipping rebalance 11:35:51,672 TRACE [org.infinispan.factories.InterceptorChainFactory] (testng) Finished building default interceptor chain. 11:35:51,677 DEBUG [org.infinispan.commons.util.ServiceFinder] (testng) No service impls found: FilterIndexingServiceProvider 11:35:51,700 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeC-21874) NodeC-21874 --> ACK(NodeB-51742: #3) 11:35:51,700 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeC-21874) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are UNICAST3: ACK, seqno=3, conn_id=1, ts=3, TP: [cluster_name=ISPN] 11:35:51,700 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:51,705 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (63 bytes) 11:35:51,700 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain size: 14 11:35:51,720 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (testng) Interceptor chain is: 11:35:51,705 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=3, conn_id=1, ts=3, TP: [cluster_name=ISPN] 11:35:51,720 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeB-51742) NodeB-51742 <-- ACK(NodeC-21874: #3, conn-id=1, ts=3) 11:35:51,720 TRACE [org.infinispan.transaction.xa.TransactionFactory] (testng) Setting factory enum to NODLD_NORECOVERY_NOXA 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute storeWrites [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:51,720 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute invalidations [r=true,w=false,is=false,type=long] 11:35:51,721 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:51,732 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:51,732 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:51,732 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStaleStatsTreshold 11:35:51,732 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:51,735 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute commits [r=true,w=false,is=false,type=long] 11:35:51,735 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:51,735 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute prepares [r=true,w=false,is=false,type=long] 11:35:51,735 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rollbacks [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationFailures [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationCount [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStatisticsEnabled 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void disconnectSource 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void recordKnownGlobalKeyset 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute elapsedTime [r=true,w=false,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictionSize [r=true,w=true,is=false,type=long] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isAffectedByRehash 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.util.List locateKey 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isLocatedLocally 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void shutdown 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void start 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void clearOperation 11:35:51,745 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void stop 11:35:51,745 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@288830c6 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 11:35:51,753 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@5a536c51 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Transactions 11:35:51,753 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@56fddb26 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache 11:35:51,753 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@636b9d07 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RpcManager 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@a0c8fac under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=LockManager 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@4b7c4b58 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@73e09dfa under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@4cdcb524 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Activation 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@224332fc under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Passivation 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@b4c9b67 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Statistics 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@7c34d8b9 under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Configuration 11:35:51,762 TRACE [org.infinispan.jmx.JmxUtil] (testng) Registered org.infinispan.jmx.ResourceDMBean@5568378e under infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 11:35:51,762 DEBUG [org.infinispan.jmx.JmxUtil] (testng) Object name infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 11:35:51,762 TRACE [org.infinispan.jmx.CacheJmxRegistration] (testng) ISPN000031: MBeans were successfully registered to the platform MBean server. 11:35:51,762 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (testng) starting distribution manager on NodeD-43076 11:35:51,762 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Starting StateTransferManager of cache dist on node NodeD-43076 11:35:51,762 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Node NodeD-43076 joining cache dist 11:35:51,762 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeD-43076, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=118b9279-4f00-4f56-aec1-b02991371145, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=SYNCHRONOUS, timeout=240000 11:35:51,762 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeD-43076, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=118b9279-4f00-4f56-aec1-b02991371145, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,763 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeD-43076: invoking unicast RPC [req-id=779] on NodeA-45995 11:35:51,763 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #5, conn_id=0) 11:35:51,774 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=779, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:51,774 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (162 bytes (810.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,774 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (165 bytes) 11:35:51,774 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=89 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=779, rsp_expected=true, UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:51,774 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #5, conn_id=0) 11:35:51,775 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#5 11:35:51,775 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 779 11:35:51,775 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeD-43076, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=118b9279-4f00-4f56-aec1-b02991371145, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} [sender=NodeD-43076] 11:35:51,775 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,775 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Added joiner NodeD-43076 to cache dist with persistent uuid 118b9279-4f00-4f56-aec1-b02991371145: members = [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], joiners = [NodeD-43076] 11:35:51,778 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Queueing rebalance for cache dist with members [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,779 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Rebalancing consistent hash for cache dist, members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076] 11:35:51,780 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeD-43076: #5) 11:35:51,780 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are UNICAST3: ACK, seqno=5, ts=6, TP: [cluster_name=ISPN] 11:35:51,780 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeC-21874: #13) 11:35:51,780 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are UNICAST3: ACK, seqno=13, ts=7, TP: [cluster_name=ISPN] 11:35:51,780 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,780 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (63 bytes) 11:35:51,780 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,780 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (63 bytes) 11:35:51,780 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Updating cache dist topology for rebalance: CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,780 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Cache dist topology updated: CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]}, members = [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], joiners = [NodeD-43076] 11:35:51,780 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t5) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,780 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t5) Pending consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:51,780 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Initialized rebalance confirmation collector 6@dist, initial list is [NodeD-43076, NodeA-45995, NodeC-21874, NodeB-51742] 11:35:51,780 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000310: Starting cluster-wide rebalance for cache dist, topology CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,781 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) [Context=dist][Scope=NodeA-45995]ISPN100002: Started local rebalance 11:35:51,781 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t5) dests=null, command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:51,781 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:51,780 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=13, ts=7, TP: [cluster_name=ISPN] 11:35:51,781 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeC-21874) NodeC-21874 <-- ACK(NodeA-45995: #13, conn-id=0, ts=7) 11:35:51,781 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t5) NodeA-45995: sending NodeA-45995#9 11:35:51,780 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeB-51742: #16) 11:35:51,781 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are UNICAST3: ACK, seqno=16, ts=8, TP: [cluster_name=ISPN] 11:35:51,781 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:51,781 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (63 bytes) 11:35:51,781 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=16, ts=8, TP: [cluster_name=ISPN] 11:35:51,781 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, ts=6, TP: [cluster_name=ISPN] 11:35:51,783 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742 <-- ACK(NodeA-45995: #16, conn-id=0, ts=8) 11:35:51,781 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 11:35:51,781 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} 11:35:51,784 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t3) Waiting on view 3 being accepted 11:35:51,784 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (8653 bytes (43265.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:51,784 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t3) Updating local topology for cache dist: CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,784 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (8656 bytes) 11:35:51,784 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t3) Starting local rebalance for cache dist, topology = CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,784 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (8656 bytes) 11:35:51,784 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t3) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,784 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (8656 bytes) 11:35:51,784 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t3) Pending consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:51,784 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=8602 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 11:35:51,784 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=8602 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 11:35:51,784 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t3) Installing new cache topology CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:51,784 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t5) NodeA-45995 used 8602 credits, 1975183 remaining 11:35:51,784 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: received NodeA-45995#9 11:35:51,784 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeA-45995#9 11:35:51,784 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=6, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,784 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) Start keeping track of keys for rebalance 11:35:51,784 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,784 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t3) Tracking is disabled. Clear tracker: {} 11:35:51,784 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t3) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:51,784 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]}, stableTopology=CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]}}} for command CacheTopologyControlCommand{cache=dist, type=JOIN, sender=NodeD-43076, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=3, timeout=240000, totalOrder=false, distributed=true, persistentUUID=118b9279-4f00-4f56-aec1-b02991371145, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} 11:35:51,784 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,784 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 779 to NodeD-43076 11:35:51,784 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:51,784 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,784 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeC-21874) NodeA-45995 used 8602 credits, 1975183 remaining 11:35:51,784 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t1) Waiting on view 3 being accepted 11:35:51,793 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeD-43076) NodeD-43076 <-- ACK(NodeA-45995: #5, conn-id=0, ts=6) 11:35:51,784 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t1) Updating local topology for cache dist: CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,801 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t1) Starting local rebalance for cache dist, topology = CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,784 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #3, conn_id=3) 11:35:51,784 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t3) Signalling topology 6 is installed 11:35:51,801 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=779, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,784 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: received NodeA-45995#9 11:35:51,801 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#9 11:35:51,801 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeC-p460-t1) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,784 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=8602 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 11:35:51,802 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (8620 bytes (43100.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,802 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#9 11:35:51,802 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#9 11:35:51,802 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (8623 bytes) 11:35:51,802 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeC-p460-t1) Pending consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:51,801 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,802 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:51,802 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:51,802 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) On cache dist we have: added segments: []; removed segments: [] 11:35:51,802 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) Topology update processed, stateTransferTopologyId = 6, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} 11:35:51,802 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t3) Signalling transaction data received for topology 6 11:35:51,802 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=8547 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=779, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,802 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #3, conn_id=3) 11:35:51,802 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#3 11:35:51,802 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:51,802 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) Finished receiving of segments for cache dist for topology 6. 11:35:51,806 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) Stop keeping track of changed keys for state transfer 11:35:51,806 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,802 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,809 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeC-p460-t1) Installing new cache topology CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:51,809 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=6, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,809 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) Start keeping track of keys for rebalance 11:35:51,809 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,809 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t1) Tracking is disabled. Clear tracker: {} 11:35:51,806 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t3) Tracking is disabled. Clear tracker: {} 11:35:51,809 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeA-45995, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} 11:35:51,806 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeD-43076) NodeA-45995 used 8602 credits, 1991390 remaining 11:35:51,809 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeD-43076) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]}, stableTopology=CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]}}} , received=true, suspected=false 11:35:51,810 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) Waiting on view 3 being accepted 11:35:51,809 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,809 DEBUG [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t5) ISPN000328: Finished local rebalance for cache dist on node NodeA-45995, topology id = 6 11:35:51,811 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,809 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t1) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:51,811 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t1) Signalling topology 6 is installed 11:35:51,811 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t3) Removing no longer owned entries for cache dist 11:35:51,811 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t3) Topology changed, recalculating minTopologyId 11:35:51,811 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t3) Changing minimum topology ID from 5 to 6 11:35:51,809 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:51,811 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,811 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:51,811 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) On cache dist we have: added segments: []; removed segments: [] 11:35:51,811 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t5) Waiting on view 3 being accepted 11:35:51,811 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) Topology update processed, stateTransferTopologyId = 6, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} 11:35:51,811 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t1) Signalling transaction data received for topology 6 11:35:51,811 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) Finished receiving of segments for cache dist for topology 6. 11:35:51,811 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) Stop keeping track of changed keys for state transfer 11:35:51,811 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,811 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t5) Updating local topology for cache dist: CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,811 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t1) Tracking is disabled. Clear tracker: {} 11:35:51,811 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t5) [Context=dist][Scope=NodeA-45995]ISPN100003: Finished local rebalance 11:35:51,810 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating local topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,812 TRACE [org.infinispan.topology.CacheTopology] (testng) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,814 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-threadNodeA-p408-t5) Rebalance confirmation collector 6@dist received confirmation for NodeA-45995, remaining list is [NodeD-43076, NodeC-21874, NodeB-51742] 11:35:51,811 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t5) Starting local rebalance for cache dist, topology = CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,811 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t1) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeC-21874, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=0 11:35:51,814 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeC-p460-t1) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeC-21874, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_NONE 11:35:51,814 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t5) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,814 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeC-p460-t1) NodeC-21874 --> DATA(NodeA-45995: #14, conn_id=0) 11:35:51,814 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t5) Pending consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:51,814 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeC-p460-t1) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 11:35:51,814 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,814 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,814 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,814 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (119 bytes) 11:35:51,814 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t1) Removing no longer owned entries for cache dist 11:35:51,814 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t5) Installing new cache topology CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:51,815 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 11:35:51,815 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #14, conn_id=0) 11:35:51,815 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#14 11:35:51,811 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 8602 credits, 1975183 remaining 11:35:51,815 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,819 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeC-21874, joinInfo=null, topologyId=6, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} [sender=NodeC-21874] 11:35:51,819 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000328: Finished local rebalance for cache dist on node NodeC-21874, topology id = 6 11:35:51,815 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=6, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,814 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t1) Topology changed, recalculating minTopologyId 11:35:51,819 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) Start keeping track of keys for rebalance 11:35:51,819 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t1) Changing minimum topology ID from 5 to 6 11:35:51,812 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Installing new cache topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} on cache dist 11:35:51,820 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Received new topology for cache dist, isRebalance = false, isMember = false, topology = CacheTopology{id=5, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,820 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling topology 5 is installed 11:35:51,820 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Requesting cluster listeners of cache dist from node NodeA-45995 11:35:51,820 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,820 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_CACHE_LISTENERS, topologyId=5, segments=null}, mode=SYNCHRONOUS, timeout=240000 11:35:51,820 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,819 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t5) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,819 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) [Context=dist][Scope=NodeC-21874]ISPN100003: Finished local rebalance 11:35:51,819 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,826 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Rebalance confirmation collector 6@dist received confirmation for NodeC-21874, remaining list is [NodeD-43076, NodeB-51742] 11:35:51,828 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t5) Tracking is disabled. Clear tracker: {} 11:35:51,828 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t5) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:51,828 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t5) Signalling topology 6 is installed 11:35:51,828 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:51,828 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) On cache dist we have: added segments: []; removed segments: [] 11:35:51,828 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) Topology update processed, stateTransferTopologyId = 6, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} 11:35:51,828 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t5) Signalling transaction data received for topology 6 11:35:51,828 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) Finished receiving of segments for cache dist for topology 6. 11:35:51,820 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeD-43076: invoking unicast RPC [req-id=800] on NodeA-45995 11:35:51,831 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #6, conn_id=0) 11:35:51,831 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=800, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 11:35:51,832 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (90 bytes (450.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,832 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (93 bytes) 11:35:51,832 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=17 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=800, rsp_expected=true, UNICAST3: DATA, seqno=6, TP: [cluster_name=ISPN] 11:35:51,832 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #6, conn_id=0) 11:35:51,832 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#6 11:35:51,832 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 800 11:35:51,832 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} [sender=NodeD-43076] 11:35:51,832 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,832 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} 11:35:51,832 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-threadNodeA-p406-t5) Request received to get cluster listeners currently registered 11:35:51,832 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-threadNodeA-p406-t5) Cluster listeners found [] 11:35:51,832 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} 11:35:51,832 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 800 to NodeD-43076 11:35:51,832 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #4, conn_id=3) 11:35:51,832 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=800, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,832 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,832 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (84 bytes) 11:35:51,833 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=800, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,828 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) Stop keeping track of changed keys for state transfer 11:35:51,833 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t5) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,833 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t5) Tracking is disabled. Clear tracker: {} 11:35:51,833 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t5) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=0 11:35:51,833 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_NONE 11:35:51,833 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t5) NodeB-51742 --> DATA(NodeA-45995: #17, conn_id=0) 11:35:51,833 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #4, conn_id=3) 11:35:51,843 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#4 11:35:51,843 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeD-43076) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:51,844 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:51,844 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) On cache dist we have: added segments: [] 11:35:51,844 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 11:35:51,844 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (testng) Signalling transaction data received for topology 5 11:35:51,844 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,844 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,844 DEBUG [org.infinispan.transaction.impl.TransactionTable] (testng) Topology changed, recalculating minTopologyId 11:35:51,844 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Changing minimum topology ID from -1 to 5 11:35:51,844 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Updating stable topology for cache dist: CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,844 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) StateTransferManager of cache dist on node NodeD-43076 received initial topology CacheTopology{id=5, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d]} 11:35:51,844 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=SYNCHRONOUS, timeout=240000 11:35:51,844 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t3) Waiting on view 3 being accepted 11:35:51,844 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,847 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeD-p532-t3) Updating local topology for cache dist: CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,847 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeD-p532-t3) Starting local rebalance for cache dist, topology = CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,847 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeD-p532-t3) Current consistent hash's routing table: 0: 0 1 2, 1: 0 1 2, 2: 0 1 2, 3: 1 0 2, 4: 1 0 2, 5: 1 0 2, 6: 0 1 2, 7: 0 1 2, 8: 1 2 0, 9: 2 0 1, 10: 0 1 2, 11: 1 2 0, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 1 2 0, 16: 2 0 1, 17: 0 2 1, 18: 2 0 1, 19: 0 1 2, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 0 2, 29: 1 0 2, 30: 1 0 2, 31: 0 2 1, 32: 0 2 1, 33: 2 1 0, 34: 2 1 0, 35: 1 2 0, 36: 1 2 0, 37: 2 1 0, 38: 1 0 2, 39: 0 1 2, 40: 0 1 2, 41: 1 0 2, 42: 1 0 2, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 2 0 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 0 2 1, 52: 2 0 1, 53: 0 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 1, 57: 0 2 1, 58: 2 0 1, 59: 0 1 2, 60: 1 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 0 1 2, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 0 2, 83: 0 2 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 2 1, 90: 0 2 1, 91: 2 1 0, 92: 1 2 0, 93: 2 0 1, 94: 2 0 1, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 1 2 0, 101: 1 2 0, 102: 1 2 0, 103: 2 0 1, 104: 0 2 1, 105: 2 0 1, 106: 0 2 1, 107: 2 0 1, 108: 0 2 1, 109: 2 0 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 0 2, 114: 1 0 2, 115: 0 2 1, 116: 2 0 1, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 1 2, 124: 0 1 2, 125: 1 0 2, 126: 0 1 2, 127: 1 2 0, 128: 2 0 1, 129: 0 2 1, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 2 1, 135: 2 1 0, 136: 2 1 0, 137: 2 1 0, 138: 1 0 2, 139: 0 1 2, 140: 1 2 0, 141: 1 2 0, 142: 2 0 1, 143: 2 0 1, 144: 0 2 1, 145: 2 0 1, 146: 0 1 2, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 0 1, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 0, 155: 2 1 0, 156: 1 0 2, 157: 0 1 2, 158: 1 2 0, 159: 2 0 1, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 1 0, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 0 2 1, 174: 2 0 1, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 0 1, 180: 0 1 2, 181: 1 2 0, 182: 2 0 1, 183: 2 0 1, 184: 0 2 1, 185: 2 1 0, 186: 1 0 2, 187: 0 2 1, 188: 2 1 0, 189: 2 1 0, 190: 1 0 2, 191: 0 2 1, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 1 0 2, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 1 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 2 0 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 2 1 0, 231: 2 1 0, 232: 1 2 0, 233: 2 1 0, 234: 2 1 0, 235: 1 2 0, 236: 2 1 0, 237: 1 2 0, 238: 2 1 0, 239: 2 1 0, 240: 2 1 0, 241: 1 0 2, 242: 0 2 1, 243: 2 0 1, 244: 2 0 1, 245: 0 2 1, 246: 2 1 0, 247: 1 0 2, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 1 0, 255: 1 0 2 11:35:51,847 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeD-p532-t3) Pending consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:51,843 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 11:35:51,847 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t5) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,847 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,847 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (119 bytes) 11:35:51,847 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeD-p532-t3) Installing new cache topology CacheTopology{id=6, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:51,847 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeD-p532-t3) This is the first topology 6 in which the local node is a member 11:35:51,847 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 11:35:51,847 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #17, conn_id=0) 11:35:51,847 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#17 11:35:51,847 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:51,848 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=6, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169, NodeD-43076: 0+201]}, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:51,848 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Start keeping track of keys for rebalance 11:35:51,848 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:51,847 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=6, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} [sender=NodeB-51742] 11:35:51,851 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,851 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000328: Finished local rebalance for cache dist on node NodeB-51742, topology id = 6 11:35:51,851 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) [Context=dist][Scope=NodeB-51742]ISPN100003: Finished local rebalance 11:35:51,851 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Rebalance confirmation collector 6@dist received confirmation for NodeB-51742, remaining list is [NodeD-43076] 11:35:51,847 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t5) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,844 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeD-43076: invoking unicast RPC [req-id=804] on NodeA-45995 11:35:51,855 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #7, conn_id=0) 11:35:51,855 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=804, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 11:35:51,855 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (89 bytes (445.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,855 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (92 bytes) 11:35:51,855 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=16 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=804, rsp_expected=true, UNICAST3: DATA, seqno=7, TP: [cluster_name=ISPN] 11:35:51,854 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t5) Removing no longer owned entries for cache dist 11:35:51,848 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t3) Tracking is disabled. Clear tracker: {} 11:35:51,860 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t3) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:51,860 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t3) Signalling topology 6 is installed 11:35:51,860 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255]; old segments: [] 11:35:51,860 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) On cache dist we have: added segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255]; removed segments: [] 11:35:51,860 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255] of cache dist 11:35:51,860 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Requesting transactions for segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] of cache dist from node NodeA-45995 11:35:51,861 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeD-p532-t3) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,856 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #7, conn_id=0) 11:35:51,861 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t5) Topology changed, recalculating minTopologyId 11:35:51,861 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#7 11:35:51,861 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t5) Changing minimum topology ID from 5 to 6 11:35:51,861 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t3) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]}, mode=SYNCHRONOUS, timeout=240000 11:35:51,862 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeD-p532-t3) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} to single recipient NodeA-45995 with response mode GET_ALL 11:35:51,862 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeD-p532-t3) NodeD-43076: invoking unicast RPC [req-id=808] on NodeA-45995 11:35:51,862 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t3) NodeD-43076 --> DATA(NodeA-45995: #8, conn_id=0) 11:35:51,862 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeD-p532-t3) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=808, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 11:35:51,861 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 804 11:35:51,865 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeD-43076] 11:35:51,865 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,865 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=dist, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:51,865 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 804 to NodeD-43076 11:35:51,865 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #5, conn_id=3) 11:35:51,865 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=804, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,862 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (457 bytes (2285.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,871 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (460 bytes) 11:35:51,874 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=384 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=808, rsp_expected=true, UNICAST3: DATA, seqno=8, TP: [cluster_name=ISPN] 11:35:51,874 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #8, conn_id=0) 11:35:51,876 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#8 11:35:51,876 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 808 11:35:51,876 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} [sender=NodeD-43076] 11:35:51,876 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:51,865 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,882 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (81 bytes) 11:35:51,882 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=804, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,876 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} 11:35:51,891 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Received request for transactions from node NodeD-43076 for segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] of cache dist with topology id 6 11:35:51,891 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Found 0 transaction(s) to transfer 11:35:51,891 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} 11:35:51,894 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 808 to NodeD-43076 11:35:51,894 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #6, conn_id=3) 11:35:51,894 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=808, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,894 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,894 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (84 bytes) 11:35:51,882 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #5, conn_id=3) 11:35:51,895 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#5 11:35:51,896 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeD-43076) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:51,896 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Waiting for initial state transfer to finish for cache dist on NodeD-43076 11:35:51,895 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=808, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=3, TP: [cluster_name=ISPN] 11:35:51,897 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #6, conn_id=3) 11:35:51,897 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#6 11:35:51,897 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:51,897 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:51,897 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Applying 0 transactions for cache dist transferred from node NodeA-45995 11:35:51,897 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Requesting transactions for segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] of cache dist from node NodeC-21874 11:35:51,897 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeD-p532-t3) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} to recipient list [NodeC-21874] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,899 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t3) dests=[NodeC-21874], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]}, mode=SYNCHRONOUS, timeout=240000 11:35:51,899 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeD-p532-t3) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} to single recipient NodeC-21874 with response mode GET_ALL 11:35:51,899 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeD-p532-t3) NodeD-43076: invoking unicast RPC [req-id=815] on NodeC-21874 11:35:51,902 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t3) NodeD-43076: created sender window for NodeC-21874 (conn-id=1) 11:35:51,902 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t3) NodeD-43076 --> DATA(NodeC-21874: #1, conn_id=1, first) 11:35:51,902 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeD-p532-t3) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=815, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:51,924 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (452 bytes (2260.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:51,924 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (455 bytes) 11:35:51,924 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) 127.0.0.1:8303: connecting to 127.0.0.1:8302 11:35:51,925 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=379 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=815, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=1, first, TP: [cluster_name=ISPN] 11:35:51,925 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #1, conn_id=1, first) 11:35:51,925 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874: created receiver window for NodeD-43076 at seqno=#1 for conn-id=1 11:35:51,925 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeD-43076#1 11:35:51,925 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 815 11:35:51,925 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeC-21874) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} [sender=NodeD-43076] 11:35:51,925 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:51,925 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t6) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} 11:35:51,925 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeC-p458-t6) Received request for transactions from node NodeD-43076 for segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] of cache dist with topology id 6 11:35:51,925 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeC-p458-t6) Found 0 transaction(s) to transfer 11:35:51,925 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} 11:35:51,925 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 815 to NodeD-43076 11:35:51,925 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874: created sender window for NodeD-43076 (conn-id=2) 11:35:51,925 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeD-43076: #1, conn_id=2, first) 11:35:51,925 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=815, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:51,925 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,925 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (84 bytes) 11:35:51,926 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=815, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:51,926 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #1, conn_id=2, first) 11:35:51,932 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: created receiver window for NodeC-21874 at seqno=#1 for conn-id=2 11:35:51,932 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeC-21874#1 11:35:51,932 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: sender=NodeC-21874value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:51,932 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} is {NodeC-21874=SuccessfulResponse{responseValue=[]} } 11:35:51,933 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Applying 0 transactions for cache dist transferred from node NodeC-21874 11:35:51,933 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Requesting transactions for segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] of cache dist from node NodeB-51742 11:35:51,933 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeD-p532-t3) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:51,933 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t3) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]}, mode=SYNCHRONOUS, timeout=240000 11:35:51,933 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeD-p532-t3) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} to single recipient NodeB-51742 with response mode GET_ALL 11:35:51,950 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeD-p532-t3) NodeD-43076: invoking unicast RPC [req-id=826] on NodeB-51742 11:35:51,950 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t3) NodeD-43076: created sender window for NodeB-51742 (conn-id=2) 11:35:51,950 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t3) NodeD-43076 --> DATA(NodeB-51742: #1, conn_id=2, first) 11:35:51,950 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeD-p532-t3) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=826, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:51,950 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (432 bytes (2160.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:51,951 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (435 bytes) 11:35:51,951 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) 127.0.0.1:8303: connecting to 127.0.0.1:8301 11:35:51,962 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=359 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=826, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:51,962 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #1, conn_id=2, first) 11:35:51,962 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: created receiver window for NodeD-43076 at seqno=#1 for conn-id=2 11:35:51,962 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeD-43076#1 11:35:51,962 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 826 11:35:51,962 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} [sender=NodeD-43076] 11:35:51,962 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:51,962 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} 11:35:51,962 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Received request for transactions from node NodeD-43076 for segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] of cache dist with topology id 6 11:35:51,962 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Found 0 transaction(s) to transfer 11:35:51,962 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} 11:35:51,962 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 826 to NodeD-43076 11:35:51,962 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742: created sender window for NodeD-43076 (conn-id=2) 11:35:51,962 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeD-43076: #1, conn_id=2, first) 11:35:51,962 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=826, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:51,962 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:51,962 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (84 bytes) 11:35:51,963 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=826, rsp_expected=true, UNICAST3: DATA, seqno=1, conn_id=2, first, TP: [cluster_name=ISPN] 11:35:51,964 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #1, conn_id=2, first) 11:35:51,964 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: created receiver window for NodeB-51742 at seqno=#1 for conn-id=2 11:35:51,964 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeB-51742#1 11:35:51,980 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: sender=NodeB-51742value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:51,980 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} is {NodeB-51742=SuccessfulResponse{responseValue=[]} } 11:35:51,980 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Applying 0 transactions for cache dist transferred from node NodeB-51742 11:35:51,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Adding transfer from NodeA-45995 for segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] 11:35:51,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Adding transfer from NodeC-21874 for segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] 11:35:51,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Adding transfer from NodeB-51742 for segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] 11:35:51,983 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Finished adding inbound state transfer for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255] of cache dist 11:35:51,983 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t1) Requesting segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] of cache dist from node NodeA-45995 11:35:51,991 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:51,991 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeD-p553-t1) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:51,991 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeD-p553-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} to addresses [NodeA-45995] with response mode GET_ALL 11:35:51,991 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Topology update processed, stateTransferTopologyId = 6, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} 11:35:51,992 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t3) Signalling transaction data received for topology 6 11:35:51,992 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:51,992 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076: invoking multicast RPC [req-id=833] 11:35:51,992 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:51,992 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076 --> DATA(NodeA-45995: #9, conn_id=0) 11:35:51,992 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=833, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 11:35:51,992 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (457 bytes (2285.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:51,992 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (460 bytes) 11:35:51,992 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t3) Removing no longer owned entries for cache dist 11:35:51,996 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t3) Topology changed, recalculating minTopologyId 11:35:51,996 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t3) Changing minimum topology ID from 5 to 6 11:35:51,999 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=384 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=833, rsp_expected=true, UNICAST3: DATA, seqno=9, TP: [cluster_name=ISPN] 11:35:51,999 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #9, conn_id=0) 11:35:51,999 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#9 11:35:51,999 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 833 11:35:52,000 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} [sender=NodeD-43076] 11:35:52,000 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,000 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} 11:35:52,000 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Starting outbound transfer of segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] to node NodeD-43076 with topology id 6 for cache dist 11:35:52,000 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Adding outbound transfer of segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] to NodeD-43076 11:35:52,000 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} 11:35:52,000 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t2) Sending last chunk containing 0 cache entries from segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] of cache dist to node NodeD-43076 11:35:52,000 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 833 to NodeD-43076 11:35:52,000 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #7, conn_id=3) 11:35:52,000 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t2) NodeA-45995 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=6} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,000 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t2) dests=[NodeD-43076], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=6}, mode=SYNCHRONOUS, timeout=240000 11:35:52,000 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t2) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=6} to single recipient NodeD-43076 with response mode GET_ALL 11:35:52,000 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t2) NodeA-45995: invoking unicast RPC [req-id=836] on NodeD-43076 11:35:52,000 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t2) NodeA-45995 --> DATA(NodeD-43076: #8, conn_id=3) 11:35:52,000 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t2) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=836, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,000 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (663 bytes (3315.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,000 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (666 bytes) 11:35:52,000 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=590 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=836, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,000 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #8, conn_id=3) 11:35:52,000 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#8 11:35:52,000 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 836 11:35:52,000 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=6} [sender=NodeA-45995] 11:35:52,001 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeD-43076) Checking if transaction data was received for topology 0, current topology is 6 11:35:52,001 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,001 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t4) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=6} 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Before applying the received state the data container of cache dist has 0 keys 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 0 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 1 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 1 of cache dist 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 2 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 2 of cache dist 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 6 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 6 of cache dist 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 129 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,010 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 129 of cache dist 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 134 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,010 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 134 of cache dist 11:35:52,010 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 139 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,010 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 10 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,001 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 0 of cache dist 11:35:52,000 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=833, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,010 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,010 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (80 bytes) 11:35:52,010 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=833, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,010 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #7, conn_id=3) 11:35:52,010 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#7 11:35:52,010 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: Responses{ NodeA-45995: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,011 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253]} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,011 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t1) Successfully requested segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] of cache dist from node NodeA-45995 11:35:52,011 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253], finishedSegments=[0, 1, 129, 2, 6, 134], unfinishedSegments=[7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@6b908fa[Not completed], topologyId=6, timeout=240000, cacheName=dist} 11:35:52,010 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 10 of cache dist 11:35:52,010 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 139 of cache dist 11:35:52,011 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 13 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,010 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 7 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,014 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 7 of cache dist 11:35:52,009 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeD-43076) NodeD-43076 --> ACK(NodeA-45995: #6) 11:35:52,023 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeD-43076) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are UNICAST3: ACK, seqno=6, conn_id=3, ts=1, TP: [cluster_name=ISPN] 11:35:52,023 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeD-43076) NodeD-43076 --> ACK(NodeC-21874: #1) 11:35:52,023 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeD-43076) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are UNICAST3: ACK, seqno=1, conn_id=2, ts=2, TP: [cluster_name=ISPN] 11:35:52,011 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 13 of cache dist 11:35:52,011 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 17 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,011 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 144 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 17 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 144 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 149 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 149 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 24 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 23 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 24 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 23 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 25 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 25 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 157 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 157 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 31 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 31 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 32 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 32 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 160 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 160 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 19 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 146 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 146 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 19 of cache dist 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 161 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,024 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 27 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 161 of cache dist 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 27 of cache dist 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 43 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 39 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 39 of cache dist 11:35:52,023 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeA-45995] 11:35:52,023 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeD-43076) NodeD-43076 --> ACK(NodeB-51742: #1) 11:35:52,029 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeD-43076) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are UNICAST3: ACK, seqno=1, conn_id=2, ts=3, TP: [cluster_name=ISPN] 11:35:52,029 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (63 bytes) 11:35:52,029 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (63 bytes) 11:35:52,030 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,030 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=6, conn_id=3, ts=1, TP: [cluster_name=ISPN] 11:35:52,030 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- ACK(NodeD-43076: #6, conn-id=3, ts=1) 11:35:52,030 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=1, conn_id=2, ts=2, TP: [cluster_name=ISPN] 11:35:52,030 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeC-21874) NodeC-21874 <-- ACK(NodeD-43076: #1, conn-id=2, ts=2) 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 40 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 40 of cache dist 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 43 of cache dist 11:35:52,028 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 163 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 163 of cache dist 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 45 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 173 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 173 of cache dist 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 172 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 172 of cache dist 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 45 of cache dist 11:35:52,038 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 47 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 47 of cache dist 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 48 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 50 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 50 of cache dist 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 51 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,030 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (63 bytes) 11:35:52,042 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=1, conn_id=2, ts=3, TP: [cluster_name=ISPN] 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 51 of cache dist 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 180 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 180 of cache dist 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 48 of cache dist 11:35:52,039 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 53 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 53 of cache dist 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 59 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 56 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 59 of cache dist 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 184 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 184 of cache dist 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 191 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 56 of cache dist 11:35:52,043 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 57 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,044 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 57 of cache dist 11:35:52,042 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeB-51742) NodeB-51742 <-- ACK(NodeD-43076: #1, conn-id=2, ts=3) 11:35:52,044 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 191 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 77 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 77 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 79 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 79 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 81 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 197 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 197 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 194 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 194 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 81 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 78 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 83 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 86 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 83 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 204 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 204 of cache dist 11:35:52,045 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 219 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,047 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 219 of cache dist 11:35:52,051 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 221 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,051 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 221 of cache dist 11:35:52,047 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 78 of cache dist 11:35:52,046 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 86 of cache dist 11:35:52,051 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 95 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,051 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 220 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,057 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 220 of cache dist 11:35:52,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 95 of cache dist 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 108 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 108 of cache dist 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 224 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 224 of cache dist 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 106 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 106 of cache dist 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 110 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 110 of cache dist 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 245 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 242 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 245 of cache dist 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 242 of cache dist 11:35:52,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 104 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 115 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 112 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 112 of cache dist 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 115 of cache dist 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 104 of cache dist 11:35:52,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Applying new state chunk for segment 120 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Finished applying chunk of segment 120 of cache dist 11:35:52,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 248 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 248 of cache dist 11:35:52,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 253 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 253 of cache dist 11:35:52,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 123 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 123 of cache dist 11:35:52,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 124 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 124 of cache dist 11:35:52,080 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t2) Finished receiving state for segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] of cache dist 11:35:52,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Inbound transfer finished: InboundTransferTask{segments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253], finishedSegments=[0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 173, 45, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253], unfinishedSegments=[], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@6b908fa[Completed normally], topologyId=6, timeout=240000, cacheName=dist} 11:35:52,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Removing inbound transfers for segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] from source NodeA-45995 for cache dist 11:35:52,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) After applying the received state the data container of cache dist has 0 keys 11:35:52,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t4) Segments not received yet for cache dist: {NodeC-21874=[InboundTransferTask{segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254], finishedSegments=[], unfinishedSegments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254], source=NodeC-21874, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4652b8fe[Not completed], topologyId=6, timeout=240000, cacheName=dist}], NodeB-51742=[InboundTransferTask{segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], finishedSegments=[], unfinishedSegments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@ddda9e9[Not completed], topologyId=6, timeout=240000, cacheName=dist}]} 11:35:52,081 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t1) Requesting segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] of cache dist from node NodeC-21874 11:35:52,081 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} to recipient list [NodeC-21874] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,081 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeD-p553-t1) dests=[NodeC-21874], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,081 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeD-p553-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} to addresses [NodeC-21874] with response mode GET_ALL 11:35:52,081 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076: invoking multicast RPC [req-id=858] 11:35:52,081 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076 --> DATA(NodeC-21874: #2, conn_id=1) 11:35:52,081 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=858, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,081 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (452 bytes (2260.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,081 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (455 bytes) 11:35:52,080 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t4) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=6} 11:35:52,089 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t4) sending rsp for 836 to NodeA-45995 11:35:52,089 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t4) NodeD-43076 --> DATA(NodeA-45995: #10, conn_id=0) 11:35:52,089 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t4) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=836, rsp_expected=true, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 11:35:52,089 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,090 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (78 bytes) 11:35:52,090 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=836, rsp_expected=true, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 11:35:52,090 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #10, conn_id=0) 11:35:52,089 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=379 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=858, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,091 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #2, conn_id=1) 11:35:52,091 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeD-43076#2 11:35:52,091 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 858 11:35:52,091 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeC-21874) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} [sender=NodeD-43076] 11:35:52,091 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,091 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t6) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} 11:35:52,093 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeC-p458-t6) Starting outbound transfer of segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] to node NodeD-43076 with topology id 6 for cache dist 11:35:52,090 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#10 11:35:52,098 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: sender=NodeD-43076, received=true, suspected=false 11:35:52,098 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=6} is {NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,098 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t2) Outbound transfer of segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] of cache dist to node NodeD-43076 is complete 11:35:52,098 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeA-p408-t2) Removing completed outbound transfer of segments [0, 1, 129, 2, 6, 134, 7, 10, 139, 13, 144, 17, 146, 19, 149, 23, 24, 25, 27, 157, 31, 32, 160, 161, 163, 39, 40, 43, 172, 45, 173, 47, 48, 50, 51, 180, 53, 56, 184, 57, 59, 191, 194, 197, 204, 77, 78, 79, 81, 83, 86, 219, 220, 221, 95, 224, 104, 106, 108, 110, 112, 242, 115, 245, 120, 248, 123, 124, 253] to NodeD-43076 for cache dist 11:35:52,093 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeC-p458-t6) Adding outbound transfer of segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] to NodeD-43076 11:35:52,099 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} 11:35:52,101 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 858 to NodeD-43076 11:35:52,101 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeC-p460-t2) Sending last chunk containing 0 cache entries from segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] of cache dist to node NodeD-43076 11:35:52,102 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeC-p460-t2) NodeC-21874 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=NodeC-21874, topologyId=6} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,102 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t2) dests=[NodeD-43076], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=NodeC-21874, topologyId=6}, mode=SYNCHRONOUS, timeout=240000 11:35:52,102 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeC-p460-t2) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=NodeC-21874, topologyId=6} to single recipient NodeD-43076 with response mode GET_ALL 11:35:52,102 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeD-43076: #2, conn_id=2) 11:35:52,106 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=858, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,102 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeC-p460-t2) NodeC-21874: invoking unicast RPC [req-id=868] on NodeD-43076 11:35:52,107 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,107 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeC-p460-t2) NodeC-21874 --> DATA(NodeD-43076: #3, conn_id=2) 11:35:52,107 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (80 bytes) 11:35:52,107 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeC-p460-t2) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=868, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,107 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (655 bytes (3275.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,107 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (658 bytes) 11:35:52,107 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=858, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,107 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=582 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=868, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,107 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #3, conn_id=2) 11:35:52,107 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeC-21874#3 11:35:52,107 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 868 11:35:52,107 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=NodeC-21874, topologyId=6} [sender=NodeC-21874] 11:35:52,107 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 0, current topology is 6 11:35:52,107 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,107 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t5) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=NodeC-21874, topologyId=6} 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Before applying the received state the data container of cache dist has 0 keys 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 128 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 135 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 133 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 133 of cache dist 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 135 of cache dist 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 136 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 128 of cache dist 11:35:52,113 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 136 of cache dist 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 9 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 137 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 9 of cache dist 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 137 of cache dist 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 143 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 142 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 142 of cache dist 11:35:52,107 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #2, conn_id=2) 11:35:52,133 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeC-21874#2 11:35:52,133 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: Responses{ NodeC-21874: sender=NodeC-21874value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,133 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254]} is {NodeC-21874=SuccessfulResponse{responseValue=null} } 11:35:52,133 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t1) Successfully requested segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] of cache dist from node NodeC-21874 11:35:52,114 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 143 of cache dist 11:35:52,133 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254], finishedSegments=[128, 133, 135, 136, 9, 137, 142], unfinishedSegments=[143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254], source=NodeC-21874, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4652b8fe[Not completed], topologyId=6, timeout=240000, cacheName=dist} 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 18 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 145 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 145 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 150 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 150 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 155 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 154 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 155 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 154 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 159 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 159 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 33 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 33 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 148 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 148 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 18 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 16 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 16 of cache dist 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 162 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,137 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 34 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 34 of cache dist 11:35:52,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 162 of cache dist 11:35:52,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 37 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 164 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 37 of cache dist 11:35:52,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 164 of cache dist 11:35:52,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 49 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 49 of cache dist 11:35:52,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 44 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,155 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 44 of cache dist 11:35:52,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 179 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,156 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 179 of cache dist 11:35:52,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 52 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 46 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,162 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 46 of cache dist 11:35:52,156 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 52 of cache dist 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 188 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 188 of cache dist 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 189 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 185 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 182 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 182 of cache dist 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 58 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 185 of cache dist 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 189 of cache dist 11:35:52,163 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 183 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 183 of cache dist 11:35:52,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 195 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 195 of cache dist 11:35:52,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 196 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 196 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 76 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 198 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 76 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 198 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 88 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 88 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 93 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 93 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 222 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 222 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 223 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 223 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 226 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 226 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 99 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 99 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 227 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 227 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 229 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 229 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 230 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 230 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 103 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 103 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 231 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 231 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 105 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 105 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 233 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 233 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 234 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 234 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 107 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 107 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 236 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 236 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 109 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 109 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 238 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 238 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 111 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 111 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 239 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 239 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 240 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 240 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 243 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 243 of cache dist 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 116 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,169 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 116 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 244 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 244 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 246 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 246 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 249 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 249 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 250 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 250 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 251 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 251 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Applying new state chunk for segment 254 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Finished applying chunk of segment 254 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 200 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 192 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,168 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 58 of cache dist 11:35:52,173 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 91 of cache dist from node NodeC-21874: received 0 cache entries 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 192 of cache dist 11:35:52,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 200 of cache dist 11:35:52,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 91 of cache dist 11:35:52,219 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t1) Finished receiving state for segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] of cache dist 11:35:52,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Inbound transfer finished: InboundTransferTask{segments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254], finishedSegments=[128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254], unfinishedSegments=[], source=NodeC-21874, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4652b8fe[Completed normally], topologyId=6, timeout=240000, cacheName=dist} 11:35:52,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Removing inbound transfers for segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] from source NodeC-21874 for cache dist 11:35:52,219 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t2) Requesting segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] of cache dist from node NodeB-51742 11:35:52,219 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeD-p553-t2) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,219 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeD-p553-t2) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,219 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeD-p553-t2) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} to addresses [NodeB-51742] with response mode GET_ALL 11:35:52,219 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeD-p553-t2) NodeD-43076: invoking multicast RPC [req-id=894] 11:35:52,219 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeD-p553-t2) NodeD-43076 --> DATA(NodeB-51742: #2, conn_id=2) 11:35:52,219 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeD-p553-t2) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=894, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) After applying the received state the data container of cache dist has 0 keys 11:35:52,219 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (432 bytes (2160.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t5) Segments not received yet for cache dist: {NodeB-51742=[InboundTransferTask{segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], finishedSegments=[], unfinishedSegments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@ddda9e9[Not completed], topologyId=6, timeout=240000, cacheName=dist}]} 11:35:52,211 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeC-21874) NodeC-21874 --> ACK(NodeD-43076: #2) 11:35:52,222 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeC-21874) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are UNICAST3: ACK, seqno=2, conn_id=1, ts=4, TP: [cluster_name=ISPN] 11:35:52,222 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,222 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (63 bytes) 11:35:52,222 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=2, conn_id=1, ts=4, TP: [cluster_name=ISPN] 11:35:52,222 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeD-43076) NodeD-43076 <-- ACK(NodeC-21874: #2, conn-id=1, ts=4) 11:35:52,219 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t5) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=NodeC-21874, topologyId=6} 11:35:52,219 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (435 bytes) 11:35:52,253 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t5) sending rsp for 868 to NodeC-21874 11:35:52,253 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t5) NodeD-43076 --> DATA(NodeC-21874: #3, conn_id=1) 11:35:52,253 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t5) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=868, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,253 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,253 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=359 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=894, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,253 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #2, conn_id=2) 11:35:52,253 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeD-43076#2 11:35:52,253 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (78 bytes) 11:35:52,258 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 894 11:35:52,259 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=868, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,259 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #3, conn_id=1) 11:35:52,259 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeD-43076#3 11:35:52,259 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} [sender=NodeD-43076] 11:35:52,259 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeC-21874) Responses: sender=NodeD-43076, received=true, suspected=false 11:35:52,259 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,259 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeC-21874) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=NodeC-21874, topologyId=6} is {NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,259 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeC-p460-t2) Outbound transfer of segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] of cache dist to node NodeD-43076 is complete 11:35:52,259 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeC-p460-t2) Removing completed outbound transfer of segments [128, 133, 135, 136, 9, 137, 142, 143, 16, 145, 18, 148, 150, 154, 155, 159, 33, 34, 162, 164, 37, 44, 46, 49, 179, 52, 182, 183, 185, 58, 188, 189, 192, 195, 196, 198, 200, 76, 88, 91, 93, 222, 223, 226, 99, 227, 229, 230, 103, 231, 105, 233, 234, 107, 236, 109, 238, 111, 239, 240, 243, 116, 244, 246, 249, 250, 251, 254] to NodeD-43076 for cache dist 11:35:52,259 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} 11:35:52,264 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Starting outbound transfer of segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] to node NodeD-43076 with topology id 6 for cache dist 11:35:52,264 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Adding outbound transfer of segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] to NodeD-43076 11:35:52,264 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} 11:35:52,264 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 894 to NodeD-43076 11:35:52,264 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeD-43076: #2, conn_id=2) 11:35:52,264 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=894, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,264 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t6) Sending last chunk containing 0 cache entries from segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] of cache dist to node NodeD-43076 11:35:52,264 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeB-p417-t6) NodeB-51742 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=6} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,264 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,264 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (80 bytes) 11:35:52,264 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=894, rsp_expected=true, UNICAST3: DATA, seqno=2, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,265 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #2, conn_id=2) 11:35:52,271 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t6) dests=[NodeD-43076], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=6}, mode=SYNCHRONOUS, timeout=240000 11:35:52,271 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t6) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=6} to single recipient NodeD-43076 with response mode GET_ALL 11:35:52,271 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeB-p417-t6) NodeB-51742: invoking unicast RPC [req-id=904] on NodeD-43076 11:35:52,271 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t6) NodeB-51742 --> DATA(NodeD-43076: #3, conn_id=2) 11:35:52,271 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t6) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=904, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,271 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (623 bytes (3115.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,265 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeB-51742#2 11:35:52,275 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: Responses{ NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,278 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=6, segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255]} is {NodeB-51742=SuccessfulResponse{responseValue=null} } 11:35:52,278 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t2) Successfully requested segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] of cache dist from node NodeB-51742 11:35:52,278 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], finishedSegments=[], unfinishedSegments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@ddda9e9[Not completed], topologyId=6, timeout=240000, cacheName=dist} 11:35:52,278 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (626 bytes) 11:35:52,282 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeA-45995) NodeA-45995 --> ACK(NodeD-43076: #10) 11:35:52,282 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeA-45995) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are UNICAST3: ACK, seqno=10, ts=9, TP: [cluster_name=ISPN] 11:35:52,282 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeA-45995) NodeA-45995 --> ACK(NodeC-21874: #14) 11:35:52,282 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=550 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=904, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,282 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #3, conn_id=2) 11:35:52,282 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeB-51742#3 11:35:52,282 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 904 11:35:52,282 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=6} [sender=NodeB-51742] 11:35:52,282 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeD-43076) Checking if transaction data was received for topology 0, current topology is 6 11:35:52,282 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,282 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=6} 11:35:52,282 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,283 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are UNICAST3: ACK, seqno=14, ts=10, TP: [cluster_name=ISPN] 11:35:52,283 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Before applying the received state the data container of cache dist has 0 keys 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 3 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 3 of cache dist 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 4 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 4 of cache dist 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 140 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 8 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 5 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 5 of cache dist 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 138 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Applying new state chunk for segment 11 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Finished applying chunk of segment 11 of cache dist 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 138 of cache dist 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 8 of cache dist 11:35:52,294 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 140 of cache dist 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Applying new state chunk for segment 141 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 147 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 147 of cache dist 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 20 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 20 of cache dist 11:35:52,283 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeA-45995) NodeA-45995 --> ACK(NodeB-51742: #17) 11:35:52,296 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are UNICAST3: ACK, seqno=17, ts=11, TP: [cluster_name=ISPN] 11:35:52,283 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (63 bytes) 11:35:52,296 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeB-51742] 11:35:52,296 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (63 bytes) 11:35:52,296 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (63 bytes) 11:35:52,297 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, ts=9, TP: [cluster_name=ISPN] 11:35:52,297 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeD-43076) NodeD-43076 <-- ACK(NodeA-45995: #10, conn-id=0, ts=9) 11:35:52,297 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=17, ts=11, TP: [cluster_name=ISPN] 11:35:52,297 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742 <-- ACK(NodeA-45995: #17, conn-id=0, ts=11) 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 21 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 21 of cache dist 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 22 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 22 of cache dist 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 26 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 26 of cache dist 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 28 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 28 of cache dist 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 156 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 156 of cache dist 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 29 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 29 of cache dist 11:35:52,297 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 30 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 30 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 35 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 35 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 36 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 36 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 38 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 38 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 41 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 41 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 42 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 42 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 170 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 170 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 171 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 171 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 176 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 176 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 177 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 177 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 178 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 178 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 181 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 181 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 186 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 186 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 60 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 60 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 190 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 190 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 193 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 193 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 199 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 199 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 201 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 201 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 202 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 202 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 75 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 75 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 203 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 203 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 205 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 205 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 206 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 206 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 80 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 80 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 82 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 82 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 87 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 87 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 92 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 92 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 96 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 96 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 97 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 97 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 225 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 225 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 98 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 98 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 100 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 100 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 228 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 228 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 101 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 101 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 102 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 102 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 232 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 232 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 235 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 235 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 237 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 237 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 113 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 113 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 241 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 241 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 114 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 114 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 247 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 247 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 121 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 121 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 122 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 122 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 127 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 127 of cache dist 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Applying new state chunk for segment 255 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,298 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Finished applying chunk of segment 255 of cache dist 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Applying new state chunk for segment 14 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished applying chunk of segment 141 of cache dist 11:35:52,299 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t4) Finished applying chunk of segment 14 of cache dist 11:35:52,295 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Applying new state chunk for segment 15 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,299 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t2) Finished applying chunk of segment 15 of cache dist 11:35:52,301 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t1) Finished receiving state for segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] of cache dist 11:35:52,301 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Inbound transfer finished: InboundTransferTask{segments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], finishedSegments=[3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255], unfinishedSegments=[], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@ddda9e9[Completed normally], topologyId=6, timeout=240000, cacheName=dist} 11:35:52,297 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=14, ts=10, TP: [cluster_name=ISPN] 11:35:52,301 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeC-21874) NodeC-21874 <-- ACK(NodeA-45995: #14, conn-id=0, ts=10) 11:35:52,301 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Removing inbound transfers for segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] from source NodeB-51742 for cache dist 11:35:52,302 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Finished receiving of segments for cache dist for topology 6. 11:35:52,302 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t1) Stop keeping track of changed keys for state transfer 11:35:52,309 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeD-p553-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,309 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeD-p553-t1) Tracking is disabled. Clear tracker: {} 11:35:52,309 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeD-p553-t1) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeD-43076, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=0 11:35:52,315 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeD-p553-t1) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeD-43076, joinInfo=null, topologyId=6, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_NONE 11:35:52,316 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076 --> DATA(NodeA-45995: #11, conn_id=0) 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeD-p553-t1) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 11:35:52,316 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) After applying the received state the data container of cache dist has 0 keys 11:35:52,316 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeD-p530-t6) Segments not received yet for cache dist: {} 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (119 bytes) 11:35:52,316 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=6} 11:35:52,316 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 904 to NodeB-51742 11:35:52,316 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeB-51742: #3, conn_id=2) 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=904, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 11:35:52,316 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #11, conn_id=0) 11:35:52,316 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#11 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,316 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (78 bytes) 11:35:52,316 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeD-43076, joinInfo=null, topologyId=6, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} [sender=NodeD-43076] 11:35:52,316 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,316 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000328: Finished local rebalance for cache dist on node NodeD-43076, topology id = 6 11:35:52,316 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=904, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,316 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #3, conn_id=2) 11:35:52,316 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeD-43076#3 11:35:52,316 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-3,NodeB-51742) Responses: sender=NodeD-43076, received=true, suspected=false 11:35:52,316 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) [Context=dist][Scope=NodeD-43076]ISPN100003: Finished local rebalance 11:35:52,316 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Rebalance confirmation collector 6@dist received confirmation for NodeD-43076, remaining list is [] 11:35:52,316 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000336: Finished cluster-wide rebalance for cache dist, topology id = 6 11:35:52,316 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Cache dist topology updated: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]}, members = [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], joiners = [] 11:35:52,316 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t5) Current consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:52,316 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-3,NodeB-51742) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=6} is {NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,316 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t6) Outbound transfer of segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] of cache dist to node NodeD-43076 is complete 11:35:52,325 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeB-p417-t6) Removing completed outbound transfer of segments [3, 4, 5, 8, 138, 11, 140, 141, 14, 15, 147, 20, 21, 22, 26, 28, 156, 29, 30, 35, 36, 38, 41, 42, 170, 171, 176, 177, 178, 181, 186, 60, 190, 193, 199, 201, 202, 75, 203, 205, 206, 80, 82, 87, 92, 96, 97, 225, 98, 100, 228, 101, 102, 232, 235, 237, 113, 241, 114, 247, 121, 122, 127, 255] to NodeD-43076 for cache dist 11:35:52,325 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t5) Updating cluster-wide current topology for cache dist, topology = CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]}, availability mode = AVAILABLE 11:35:52,325 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} 11:35:52,325 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t4) Waiting on view 3 being accepted 11:35:52,325 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t4) Updating local topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,325 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t5) dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:52,326 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:52,326 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t5) NodeA-45995: sending NodeA-45995#10 11:35:52,326 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 11:35:52,326 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t5) NodeA-45995 used 4416 credits, 1970767 remaining 11:35:52,326 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (4467 bytes (22335.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:52,326 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (4470 bytes) 11:35:52,326 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=4416 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 11:35:52,326 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#10 11:35:52,326 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#10 11:35:52,326 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,328 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,328 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,328 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 4416 credits, 1970767 remaining 11:35:52,328 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t2) Waiting on view 3 being accepted 11:35:52,329 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t2) Updating local topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,329 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t2) Current consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:52,326 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (4470 bytes) 11:35:52,326 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Updating stable topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,336 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t5) Updating cluster-wide stable topology for cache dist, topology = CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,336 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (4470 bytes) 11:35:52,336 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t5) dests=null, command=CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:52,336 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:52,336 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t5) NodeA-45995: sending NodeA-45995#11 11:35:52,336 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=4416 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 11:35:52,336 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: received NodeA-45995#10 11:35:52,336 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#10 11:35:52,336 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 11:35:52,336 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t5) NodeA-45995 used 4415 credits, 1966352 remaining 11:35:52,336 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (4466 bytes (22330.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:52,336 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (4469 bytes) 11:35:52,325 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t4) Current consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:52,340 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t4) Installing new cache topology CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,340 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=7, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,340 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t4) Signalling topology 7 is installed 11:35:52,340 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 93, 94, 95, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 128, 129, 130, 131, 132, 133, 134, 142, 143, 144, 146, 147, 148, 149, 150, 151, 152, 153, 158, 159, 160, 161, 162, 163, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 182, 183, 184, 185, 186, 187, 190, 191, 192, 193, 194, 195, 196, 197, 201, 202, 203, 204, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:52,340 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) On cache dist we have: added segments: []; removed segments: [14, 15, 16, 32, 33, 34, 35, 36, 51, 52, 53, 75, 82, 91, 92, 96, 97, 98, 99, 100, 101, 102, 127, 135, 136, 137, 138, 139, 140, 141, 145, 154, 155, 156, 157, 164, 176, 177, 178, 179, 180, 181, 188, 189, 198, 199, 200, 205, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250] 11:35:52,341 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Topology update processed, stateTransferTopologyId = 6, startRebalance = false, pending CH = null 11:35:52,337 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (4469 bytes) 11:35:52,341 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (4469 bytes) 11:35:52,341 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=4415 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 11:35:52,336 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,336 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} 11:35:52,341 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#11 11:35:52,336 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=4416 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 11:35:52,341 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=4415 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 11:35:52,341 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: received NodeA-45995#11 11:35:52,329 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t2) Installing new cache topology CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,341 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t2) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=7, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,341 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t2) Signalling topology 7 is installed 11:35:52,341 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,341 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,341 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t4) Waiting on view 3 being accepted 11:35:52,341 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeD-43076) NodeA-45995 used 4416 credits, 1986974 remaining 11:35:52,341 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t2) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 32, 33, 34, 35, 36, 38, 39, 40, 41, 51, 52, 53, 54, 55, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 77, 78, 79, 80, 81, 82, 84, 85, 86, 87, 89, 90, 91, 92, 94, 95, 96, 97, 98, 99, 100, 101, 102, 110, 111, 112, 113, 114, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 130, 131, 132, 135, 136, 137, 138, 139, 140, 141, 145, 146, 147, 151, 152, 153, 154, 155, 156, 157, 158, 164, 165, 166, 167, 168, 169, 170, 171, 174, 175, 176, 177, 178, 179, 180, 181, 187, 188, 189, 190, 191, 192, 193, 197, 198, 199, 200, 201, 202, 203, 204, 205, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250, 251, 252, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:52,342 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t2) On cache dist we have: added segments: []; removed segments: [6, 7, 8, 9, 10, 11, 30, 31, 37, 42, 43, 44, 45, 46, 47, 48, 49, 50, 56, 57, 58, 59, 60, 76, 83, 88, 93, 103, 104, 105, 106, 107, 108, 109, 115, 116, 128, 129, 133, 134, 142, 143, 144, 148, 149, 150, 159, 160, 161, 162, 163, 172, 173, 182, 183, 184, 185, 186, 194, 195, 196, 206, 219, 220, 221, 222, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 253, 254] 11:35:52,342 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t2) Topology update processed, stateTransferTopologyId = 6, startRebalance = false, pending CH = null 11:35:52,342 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t2) Stop keeping track of changed keys for state transfer 11:35:52,341 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#11 11:35:52,341 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#11 11:35:52,343 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: received NodeA-45995#10 11:35:52,343 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,343 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeC-21874) NodeC-21874: delivering NodeA-45995#10 11:35:52,343 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,341 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Stop keeping track of changed keys for state transfer 11:35:52,343 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t4) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,343 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t4) Tracking is disabled. Clear tracker: {} 11:35:52,343 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,343 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} with new topology 7 and was pre false 11:35:52,343 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,343 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t4) No change listeners present! 11:35:52,343 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Unlock State Transfer in Progress for topology ID 7 11:35:52,343 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t4) Signalling transaction data received for topology 7 11:35:52,343 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,343 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeC-p460-t3) Waiting on view 3 being accepted 11:35:52,340 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=4415 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 11:35:52,343 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#11 11:35:52,343 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,343 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#11 11:35:52,343 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeC-21874) NodeA-45995 used 4416 credits, 1970767 remaining 11:35:52,343 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,343 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,343 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,343 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 4415 credits, 1966352 remaining 11:35:52,343 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,343 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,343 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,343 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 4415 credits, 1966352 remaining 11:35:52,342 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t2) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,343 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t2) Tracking is disabled. Clear tracker: {} 11:35:52,352 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeD-p532-t4) Updating local topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,352 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeD-p532-t4) Current consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:52,352 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeD-p532-t4) Installing new cache topology CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,352 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t4) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=7, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,352 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t4) Signalling topology 7 is installed 11:35:52,353 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t4) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255] 11:35:52,353 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t4) On cache dist we have: added segments: []; removed segments: [] 11:35:52,353 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t4) Topology update processed, stateTransferTopologyId = 6, startRebalance = false, pending CH = null 11:35:52,353 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t4) Stop keeping track of changed keys for state transfer 11:35:52,353 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t4) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,353 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t4) Tracking is disabled. Clear tracker: {} 11:35:52,353 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeD-p532-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} with new topology 7 and was pre false 11:35:52,353 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeD-p532-t4) No change listeners present! 11:35:52,353 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t4) Unlock State Transfer in Progress for topology ID 7 11:35:52,353 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t4) Signalling transaction data received for topology 7 11:35:52,344 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t2) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} with new topology 7 and was pre false 11:35:52,354 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t2) No change listeners present! 11:35:52,354 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t2) Unlock State Transfer in Progress for topology ID 7 11:35:52,354 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t2) Signalling transaction data received for topology 7 11:35:52,343 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,354 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,343 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t3) Updating local topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,357 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t4) Removing no longer owned entries for cache dist 11:35:52,357 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeC-p460-t3) Current consistent hash's routing table: 0: 0 3 1, 1: 3 0 1, 2: 0 3 1, 3: 3 1 0, 4: 1 3 0, 5: 1 3 0, 6: 3 0 2, 7: 0 3 2, 8: 3 2 0, 9: 2 0 3, 10: 0 3 2, 11: 3 2 0, 12: 2 0 1, 13: 0 1 3, 14: 1 3 2, 15: 3 2 1, 16: 2 3 1, 17: 3 1 0, 18: 3 1 0, 19: 3 1 0, 20: 1 0 3, 21: 1 0 3, 22: 1 0 3, 23: 0 1 3, 24: 0 1 3, 25: 0 1 3, 26: 1 0 3, 27: 0 1 3, 28: 1 3 0, 29: 1 3 0, 30: 3 0 2, 31: 0 3 2, 32: 3 2 1, 33: 2 3 1, 34: 2 3 1, 35: 3 1 2, 36: 1 2 3, 37: 2 3 0, 38: 3 0 1, 39: 0 3 1, 40: 3 1 0, 41: 1 3 0, 42: 3 0 2, 43: 0 2 3, 44: 2 3 0, 45: 3 2 0, 46: 2 0 3, 47: 0 3 2, 48: 0 3 2, 49: 3 0 2, 50: 0 3 2, 51: 3 2 1, 52: 2 3 1, 53: 3 2 1, 54: 2 1 0, 55: 1 0 2, 56: 0 2 3, 57: 0 2 3, 58: 2 0 3, 59: 0 3 2, 60: 3 2 0, 61: 2 0 1, 62: 0 1 2, 63: 1 2 0, 64: 2 0 1, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 3, 76: 2 3 0, 77: 3 0 1, 78: 0 1 3, 79: 0 1 3, 80: 1 0 3, 81: 0 1 3, 82: 1 3 2, 83: 3 2 0, 84: 2 0 1, 85: 2 0 1, 86: 0 1 3, 87: 1 3 0, 88: 3 0 2, 89: 0 2 1, 90: 0 2 1, 91: 2 1 3, 92: 1 3 2, 93: 3 2 0, 94: 2 0 1, 95: 0 1 3, 96: 1 3 2, 97: 1 3 2, 98: 1 3 2, 99: 3 1 2, 100: 3 1 2, 101: 1 2 3, 102: 1 2 3, 103: 2 3 0, 104: 3 2 0, 105: 3 2 0, 106: 3 2 0, 107: 2 0 3, 108: 0 2 3, 109: 2 0 3, 110: 0 3 1, 111: 3 0 1, 112: 0 1 3, 113: 1 3 0, 114: 1 3 0, 115: 3 0 2, 116: 3 0 2, 117: 0 2 1, 118: 0 2 1, 119: 2 0 1, 120: 0 1 3, 121: 1 0 3, 122: 1 0 3, 123: 0 3 1, 124: 3 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 2 3, 128: 2 3 0, 129: 3 2 0, 130: 2 0 1, 131: 0 1 2, 132: 1 2 0, 133: 2 0 3, 134: 0 2 3, 135: 2 3 1, 136: 2 3 1, 137: 2 3 1, 138: 3 1 2, 139: 3 1 2, 140: 3 1 2, 141: 1 3 2, 142: 3 2 0, 143: 2 0 3, 144: 0 2 3, 145: 2 3 1, 146: 3 1 0, 147: 1 3 0, 148: 3 0 2, 149: 0 3 2, 150: 3 2 0, 151: 2 0 1, 152: 0 2 1, 153: 0 2 1, 154: 2 1 3, 155: 2 1 3, 156: 1 3 2, 157: 3 1 2, 158: 1 2 0, 159: 2 0 3, 160: 0 3 2, 161: 0 3 2, 162: 3 0 2, 163: 0 3 2, 164: 3 2 1, 165: 2 1 0, 166: 2 1 0, 167: 1 2 0, 168: 1 2 0, 169: 2 1 0, 170: 1 0 3, 171: 1 0 3, 172: 0 3 2, 173: 3 2 0, 174: 2 0 1, 175: 0 1 2, 176: 1 2 3, 177: 1 2 3, 178: 1 2 3, 179: 2 3 1, 180: 3 1 2, 181: 1 2 3, 182: 2 3 0, 183: 2 3 0, 184: 3 2 0, 185: 2 3 0, 186: 3 0 2, 187: 0 2 1, 188: 2 1 3, 189: 2 1 3, 190: 1 3 0, 191: 3 1 0, 192: 3 1 0, 193: 1 0 3, 194: 0 3 2, 195: 3 2 0, 196: 2 0 3, 197: 0 3 1, 198: 3 1 2, 199: 1 2 3, 200: 2 3 1, 201: 3 1 0, 202: 1 0 3, 203: 1 0 3, 204: 0 1 3, 205: 1 3 2, 206: 3 2 0, 207: 2 0 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 3, 220: 0 2 3, 221: 0 2 3, 222: 2 3 0, 223: 3 0 1, 224: 0 1 3, 225: 1 3 2, 226: 3 2 1, 227: 2 1 3, 228: 1 3 2, 229: 3 2 1, 230: 2 1 3, 231: 2 1 3, 232: 1 3 2, 233: 3 2 1, 234: 2 1 3, 235: 1 3 2, 236: 3 1 2, 237: 1 2 3, 238: 2 3 0, 239: 2 3 0, 240: 2 3 0, 241: 3 0 2, 242: 0 2 3, 243: 2 0 3, 244: 2 0 3, 245: 0 2 3, 246: 2 3 0, 247: 3 0 2, 248: 0 2 3, 249: 2 3 1, 250: 2 3 1, 251: 3 1 0, 252: 1 0 2, 253: 0 2 3, 254: 2 3 0, 255: 3 0 1 11:35:52,357 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeC-p460-t3) Installing new cache topology CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,357 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Topology changed, recalculating minTopologyId 11:35:52,357 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t4) Changing minimum topology ID from 6 to 7 11:35:52,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=7, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,357 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t3) Signalling topology 7 is installed 11:35:52,357 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t4) Updating stable topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,356 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeD-43076) NodeA-45995 used 4415 credits, 1982559 remaining 11:35:52,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) On cache dist we have: new segments: [6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 30, 31, 32, 33, 34, 35, 36, 37, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 82, 83, 84, 85, 88, 89, 90, 91, 92, 93, 94, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 115, 116, 117, 118, 119, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 194, 195, 196, 198, 199, 200, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 252, 253, 254]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:52,357 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) On cache dist we have: added segments: []; removed segments: [0, 1, 2, 3, 4, 5, 13, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 38, 39, 40, 41, 77, 78, 79, 80, 81, 86, 87, 95, 110, 111, 112, 113, 114, 120, 121, 122, 123, 124, 146, 147, 170, 171, 190, 191, 192, 193, 197, 201, 202, 203, 204, 223, 224, 251, 255] 11:35:52,354 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t2) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,357 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t2) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,357 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t2) Removing no longer owned entries for cache dist 11:35:52,357 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t2) Topology changed, recalculating minTopologyId 11:35:52,353 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t4) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,358 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t4) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,358 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t4) Removing no longer owned entries for cache dist 11:35:52,357 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t2) Changing minimum topology ID from 6 to 7 11:35:52,365 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t2) Updating stable topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,365 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Topology update processed, stateTransferTopologyId = 6, startRebalance = false, pending CH = null 11:35:52,365 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Stop keeping track of changed keys for state transfer 11:35:52,365 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,365 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeC-p460-t3) Tracking is disabled. Clear tracker: {} 11:35:52,365 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeC-p460-t3) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 90+166, NodeB-51742: 79+177, NodeC-21874: 87+169]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]} with new topology 7 and was pre false 11:35:52,365 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeC-p460-t3) No change listeners present! 11:35:52,365 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Unlock State Transfer in Progress for topology ID 7 11:35:52,365 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeC-p460-t3) Signalling transaction data received for topology 7 11:35:52,365 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,365 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,365 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeC-p460-t3) Removing no longer owned entries for cache dist 11:35:52,365 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) Topology changed, recalculating minTopologyId 11:35:52,365 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeC-p460-t3) Changing minimum topology ID from 6 to 7 11:35:52,360 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t4) Topology changed, recalculating minTopologyId 11:35:52,366 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t4) Changing minimum topology ID from 6 to 7 11:35:52,366 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeD-p532-t4) Initial state transfer complete for cache dist on node NodeD-43076 11:35:52,365 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeC-p460-t3) Updating stable topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,366 DEBUG [org.infinispan.cache.impl.CacheImpl] (testng) Started cache dist on NodeD-43076 11:35:52,374 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Closing latch for cache dist 11:35:52,366 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeD-p532-t4) Updating stable topology for cache dist: CacheTopology{id=7, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[NodeA-45995: 67+126, NodeB-51742: 61+116, NodeC-21874: 65+132, NodeD-43076: 63+138]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 0fa68d1e-3f42-4ce4-9900-8b153048bf3d, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,418 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeB-51742) NodeB-51742 --> ACK(NodeD-43076: #3) 11:35:52,424 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeB-51742) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are UNICAST3: ACK, seqno=3, conn_id=2, ts=4, TP: [cluster_name=ISPN] 11:35:52,424 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,424 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (63 bytes) 11:35:52,424 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=3, conn_id=2, ts=4, TP: [cluster_name=ISPN] 11:35:52,424 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeD-43076) NodeD-43076 <-- ACK(NodeB-51742: #3, conn-id=2, ts=4) 11:35:52,474 TRACE [org.infinispan.test.TestingUtil] (testng) Node NodeA-45995 finished state transfer. 11:35:52,475 TRACE [org.infinispan.test.TestingUtil] (testng) Node NodeB-51742 finished state transfer. 11:35:52,475 TRACE [org.infinispan.test.TestingUtil] (testng) Node NodeC-21874 finished state transfer. 11:35:52,475 TRACE [org.infinispan.test.TestingUtil] (testng) Node NodeD-43076 finished state transfer. 11:35:52,475 DEBUG [org.infinispan.distribution.rehash. (testng) Cache managers created, ready to start the test 11:35:52,485 DEBUG [org.infinispan.commons.test.TestNGTestListener] (testng) After setup createBeforeMethod [TestSuiteProgress] Test starting: org.infinispan.distribution.rehash. 11:35:52,485 INFO [org.infinispan.commons.test.TestSuiteProgress] (testng) Test starting: org.infinispan.distribution.rehash. 11:35:52,486 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Implicit transaction started! Transaction: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:30 status: ActionStatus.RUNNING > 11:35:52,486 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@16 11:35:52,486 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@5b1c1a09] 11:35:52,487 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, origin null 11:35:52,487 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:52,487 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container null 11:35:52,487 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Creating new entry for key MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} 11:35:52,487 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Updated context entry ReadCommittedEntry(33ad4258){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,487 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PutKeyValueCommand 11:35:52,488 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (testng) The return value is null 11:35:52,489 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Release locks for keys=[]. owner=GlobalTx:NodeA-45995:22 11:35:52,489 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Clearing locked keys: [] 11:35:52,491 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) Adding modification PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}. Mod list is null 11:35:52,491 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Committing transaction as it was implicit: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:30 status: ActionStatus.RUNNING > 11:35:52,491 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@16 11:35:52,491 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=-1} 11:35:52,491 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@14a62b1f] 11:35:52,491 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=-1}, origin null 11:35:52,491 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) Acquiring locks on MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. 11:35:52,491 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Await for pending transactions for transaction GlobalTx:NodeA-45995:22 using null 11:35:52,491 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Locking keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], no need to check for pending locks. 11:35:52,491 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Registering locked key: MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} 11:35:52,491 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Lock key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} for owner=GlobalTx:NodeA-45995:22. timeout=45000 (MILLISECONDS) 11:35:52,492 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Acquire lock for GlobalTx:NodeA-45995:22. Timeout=45000 (MILLISECONDS) 11:35:52,492 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeA-45995:22} 11:35:52,492 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeA-45995:22}. Current=null 11:35:52,492 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeA-45995:22}) => true 11:35:52,492 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeA-45995:22}. WAITING => ACQUIRED 11:35:52,492 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeA-45995:22} successfully acquired the lock. 11:35:52,492 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) *Not* performing local write skew check for key MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} 11:35:52,492 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PrepareCommand 11:35:52,492 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 11:35:52,492 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeA-45995 invoking PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeA-45995, NodeC-21874] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,492 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeC-21874], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,492 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} to addresses [NodeD-43076, NodeC-21874] with response mode GET_ALL 11:35:52,492 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeA-45995: invoking multicast RPC [req-id=979] 11:35:52,492 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeA-45995 --> DATA(NodeC-21874: #9, conn_id=2) 11:35:52,492 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,492 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeA-45995 --> DATA(NodeD-43076: #9, conn_id=3) 11:35:52,492 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,492 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (410 bytes) 11:35:52,493 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,493 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #9, conn_id=2) 11:35:52,492 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,493 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,493 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#9 11:35:52,498 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (410 bytes) 11:35:52,498 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 979 11:35:52,498 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} [sender=NodeA-45995] 11:35:52,498 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeC-21874) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,498 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,504 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #9, conn_id=3) 11:35:52,504 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#9 11:35:52,504 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 979 11:35:52,504 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} [sender=NodeA-45995] 11:35:52,504 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,504 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-2,NodeD-43076) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,504 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,505 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,505 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeD-p530-t6) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@916ca58f 11:35:52,505 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeD-p530-t6) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@916ca58f] 11:35:52,505 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeD-p530-t6) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7}, origin NodeA-45995 11:35:52,505 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeD-p530-t6) Acquiring backup locks on MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. 11:35:52,507 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Exists in context? null 11:35:52,507 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Retrieved from container null 11:35:52,508 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-1,NodeC-21874) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,507 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Creating new entry for key MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} 11:35:52,508 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,508 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t6) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,509 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeC-p458-t6) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@916ca58f 11:35:52,509 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeC-p458-t6) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@916ca58f] 11:35:52,509 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeC-p458-t6) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7}, origin NodeA-45995 11:35:52,509 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeC-p458-t6) Acquiring backup locks on MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. 11:35:52,509 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Exists in context? null 11:35:52,509 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Retrieved from container null 11:35:52,509 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Creating new entry for key MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} 11:35:52,509 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeC-p458-t6) Adding key MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} to tx GlobalTx:NodeA-45995:22 11:35:52,509 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Updated context entry ReadCommittedEntry(6ee6d846){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,509 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) Registering requestor NodeA-45995 for key 'MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}' 11:35:52,509 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeC-p458-t6) Invoking: PutKeyValueCommand 11:35:52,509 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeC-p458-t6) Invoking: PrepareCommand 11:35:52,509 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeC-p458-t6) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,509 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeC-p458-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(6ee6d846){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,509 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,509 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 979 to NodeA-45995 11:35:52,509 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeA-45995: #15, conn_id=0) 11:35:52,509 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 11:35:52,509 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,509 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (78 bytes) 11:35:52,508 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeD-p530-t6) Adding key MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} to tx GlobalTx:NodeA-45995:22 11:35:52,509 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Updated context entry ReadCommittedEntry(50298c4a){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,509 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeA-45995 for key 'MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}' 11:35:52,509 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: PutKeyValueCommand 11:35:52,509 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: PrepareCommand 11:35:52,509 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeD-p530-t6) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,509 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeD-p530-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(50298c4a){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,509 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,510 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 979 to NodeA-45995 11:35:52,509 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 11:35:52,510 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #15, conn_id=0) 11:35:52,510 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeA-45995: #12, conn_id=0) 11:35:52,510 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#15 11:35:52,511 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 11:35:52,511 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,511 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (78 bytes) 11:35:52,517 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=979, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 11:35:52,517 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #12, conn_id=0) 11:35:52,517 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#12 11:35:52,517 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: Responses{ NodeD-43076: sender=NodeD-43076, received=true, suspected=false NodeC-21874: sender=NodeC-21874, received=true, suspected=false} 11:35:52,517 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} is {NodeC-21874=SuccessfulResponse{responseValue=null} , NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,517 TRACE [org.infinispan.transaction.impl.LocalTransaction] (OOB-2,NodeA-45995) Adding remote locks on [NodeD-43076, NodeA-45995, NodeC-21874]. Remote locks are null 11:35:52,517 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeA-45995) Executing invocation handler L1LastChanceInterceptor$$Lambda$295/260693056 with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,517 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeA-45995, NodeC-21874], isMarkedForRollback=false, lockedKeys=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@16. 11:35:52,517 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Committing transaction GlobalTx:NodeA-45995:22 11:35:52,517 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@2341a2f8] 11:35:52,517 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=-1}, origin null 11:35:52,517 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (testng) No L1 caches to invalidate for keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,517 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 11:35:52,517 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeA-45995, NodeC-21874], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,517 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeA-45995 invoking CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeA-45995, NodeC-21874] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,517 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeC-21874], command=CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,517 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} to addresses [NodeD-43076, NodeC-21874] with response mode GET_ALL 11:35:52,518 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeA-45995: invoking multicast RPC [req-id=988] 11:35:52,518 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeA-45995 --> DATA(NodeC-21874: #10, conn_id=2) 11:35:52,518 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,518 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeA-45995 --> DATA(NodeD-43076: #10, conn_id=3) 11:35:52,518 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,518 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (119 bytes (595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,518 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (122 bytes) 11:35:52,518 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (119 bytes (595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,518 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (122 bytes) 11:35:52,519 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,519 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,519 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #10, conn_id=2) 11:35:52,519 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #10, conn_id=3) 11:35:52,519 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#10 11:35:52,519 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#10 11:35:52,519 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 988 11:35:52,519 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 988 11:35:52,520 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} [sender=NodeA-45995] 11:35:52,520 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} [sender=NodeA-45995] 11:35:52,520 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeC-21874) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,520 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,520 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,520 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t6) Calling perform() on CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,520 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeC-p458-t6) About to execute tx command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,520 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeC-p458-t6) Invoked with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@916ca58f] 11:35:52,520 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,520 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,523 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeD-p530-t6) About to execute tx command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,523 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeD-p530-t6) Invoked with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@916ca58f] 11:35:52,523 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeD-p530-t6) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7}, origin NodeA-45995 11:35:52,523 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeD-p530-t6) Remote tx topology id 7 and command topology is 7 11:35:52,524 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeA-45995 for key 'MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}' 11:35:52,524 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) No L1 caches to invalidate for keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,524 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: CommitCommand 11:35:52,524 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeD-p530-t6) About to commit entry ReadCommittedEntry(50298c4a){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,524 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeD-p530-t6) Trying to commit. Key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. Operation Flag=null, L1 invalidation=false 11:35:52,523 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeC-p458-t6) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7}, origin NodeA-45995 11:35:52,527 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeC-p458-t6) Remote tx topology id 7 and command topology is 7 11:35:52,528 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) Registering requestor NodeA-45995 for key 'MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}' 11:35:52,528 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) No L1 caches to invalidate for keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,527 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeD-p530-t6) Committing key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,528 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeD-p530-t6) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v1 11:35:52,528 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeD-p530-t6) Store ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} in container 11:35:52,528 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeD-p530-t6) Sending additional invalidation for requestors if necessary. 11:35:52,528 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeA-45995 for key 'MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}' 11:35:52,528 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) No L1 caches to invalidate for keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,528 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeD-p530-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(50298c4a){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,528 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,528 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 988 to NodeA-45995 11:35:52,528 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeA-45995: #13, conn_id=0) 11:35:52,528 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 11:35:52,528 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,528 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (80 bytes) 11:35:52,528 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 11:35:52,528 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #13, conn_id=0) 11:35:52,528 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#13 11:35:52,528 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeC-p458-t6) Invoking: CommitCommand 11:35:52,529 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeC-p458-t6) About to commit entry ReadCommittedEntry(6ee6d846){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,529 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeC-p458-t6) Trying to commit. Key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. Operation Flag=null, L1 invalidation=false 11:35:52,530 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeD-43076) NodeD-43076 --> ACK(NodeA-45995: #10) 11:35:52,530 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeD-43076) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are UNICAST3: ACK, seqno=10, conn_id=3, ts=4, TP: [cluster_name=ISPN] 11:35:52,530 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeD-43076) NodeD-43076 --> ACK(NodeC-21874: #3) 11:35:52,530 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,530 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeD-43076) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are UNICAST3: ACK, seqno=3, conn_id=2, ts=5, TP: [cluster_name=ISPN] 11:35:52,533 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeD-43076) NodeD-43076 --> ACK(NodeB-51742: #3) 11:35:52,533 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeD-43076) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are UNICAST3: ACK, seqno=3, conn_id=2, ts=6, TP: [cluster_name=ISPN] 11:35:52,530 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeC-p458-t6) Committing key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,533 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeC-p458-t6) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v1 11:35:52,533 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeC-p458-t6) Store ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} in container 11:35:52,533 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeC-p458-t6) Sending additional invalidation for requestors if necessary. 11:35:52,533 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) Registering requestor NodeA-45995 for key 'MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}' 11:35:52,534 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (63 bytes) 11:35:52,534 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeB-51742] 11:35:52,534 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (63 bytes) 11:35:52,534 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, conn_id=3, ts=4, TP: [cluster_name=ISPN] 11:35:52,534 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (63 bytes) 11:35:52,534 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=3, conn_id=2, ts=6, TP: [cluster_name=ISPN] 11:35:52,534 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeB-51742) NodeB-51742 <-- ACK(NodeD-43076: #3, conn-id=2, ts=6) 11:35:52,534 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=3, conn_id=2, ts=5, TP: [cluster_name=ISPN] 11:35:52,534 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeC-21874) NodeC-21874 <-- ACK(NodeD-43076: #3, conn-id=2, ts=5) 11:35:52,534 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- ACK(NodeD-43076: #10, conn-id=3, ts=4) 11:35:52,534 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) No L1 caches to invalidate for keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,543 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeC-p458-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(6ee6d846){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,545 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,555 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 988 to NodeA-45995 11:35:52,558 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeA-45995: #16, conn_id=0) 11:35:52,558 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 11:35:52,558 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,560 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (80 bytes) 11:35:52,560 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=988, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 11:35:52,560 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #16, conn_id=0) 11:35:52,560 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#16 11:35:52,560 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: Responses{ NodeD-43076: sender=NodeD-43076value=SuccessfulResponse{responseValue=null} , received=true, suspected=false NodeC-21874: sender=NodeC-21874value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,560 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Response(s) to CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} is {NodeC-21874=SuccessfulResponse{responseValue=null} , NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,560 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeA-45995) Executing invocation handler EntryWrappingInterceptor$$Lambda$103/2071385989 with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,560 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (OOB-2,NodeA-45995) About to commit entry ReadCommittedEntry(33ad4258){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,560 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-2,NodeA-45995) Trying to commit. Key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. Operation Flag=null, L1 invalidation=false 11:35:52,560 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-2,NodeA-45995) Committing key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,560 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-2,NodeA-45995) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v1 11:35:52,560 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-2,NodeA-45995) Store ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} in container 11:35:52,560 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeA-45995) Executing invocation handler L1LastChanceInterceptor$$Lambda$301/976075877 with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,560 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (OOB-2,NodeA-45995) Sending additional invalidation for requestors if necessary. 11:35:52,560 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (OOB-2,NodeA-45995) No L1 caches to invalidate for keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,560 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeA-45995) Executing invocation handler NotificationInterceptor$1 with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,560 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeA-45995) Executing invocation handler AbstractTxLockingInterceptor$$Lambda$302/632765933 with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,560 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (OOB-2,NodeA-45995) Release locks for keys=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}]. owner=GlobalTx:NodeA-45995:22 11:35:52,563 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeA-45995) Release lock for GlobalTx:NodeA-45995:22. 11:35:52,567 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeA-45995) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeA-45995:22}. ACQUIRED => RELEASED 11:35:52,567 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeA-45995) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeA-45995:22}? true 11:35:52,567 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeA-45995) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeA-45995:22} 11:35:52,567 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeA-45995) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeA-45995:22}, null) => true 11:35:52,567 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeA-45995) Try acquire. Next in queue=null. Current=null 11:35:52,567 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (OOB-2,NodeA-45995) Clearing locked keys: [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,567 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeA-45995) Executing invocation handler TxInterceptor$$Lambda$304/10629423 with command CommitCommand {gtx=GlobalTx:NodeA-45995:22, cacheName='dist', topologyId=7} 11:35:52,567 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Removed LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeA-45995, NodeC-21874], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@16 from transaction table. 11:35:52,567 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Transaction GlobalTx:NodeA-45995:22 has completed, notifying listening threads. 11:35:52,567 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Committed in onePhase? false isOptimistic? true 11:35:52,567 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeA-45995, NodeC-21874], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,568 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) About to invoke tx completion notification on commitNodes: [NodeD-43076, NodeA-45995, NodeC-21874] 11:35:52,568 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeA-45995 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} to recipient list [NodeD-43076, NodeA-45995, NodeC-21874] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,568 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Topology id missing on command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} , setting it to 7 11:35:52,568 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeC-21874], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} , mode=ASYNCHRONOUS, timeout=60000 11:35:52,569 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} to addresses [NodeD-43076, NodeC-21874] with response mode GET_NONE 11:35:52,569 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeA-45995 --> DATA(NodeC-21874: #11, conn_id=2) 11:35:52,569 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,569 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeA-45995 --> DATA(NodeD-43076: #11, conn_id=3) 11:35:52,569 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,569 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} is {} 11:35:52,569 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Implicit transaction started! Transaction: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:32 status: ActionStatus.RUNNING > 11:35:52,569 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@17 11:35:52,569 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@36b7a2fe] 11:35:52,570 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, origin null 11:35:52,570 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:52,570 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container null 11:35:52,570 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Creating new entry for key MagicKey#k2{19/D9F36386/122@NodeB-51742} 11:35:52,570 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Updated context entry ReadCommittedEntry(273a948){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,570 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PutKeyValueCommand 11:35:52,570 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (testng) The return value is null 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Release locks for keys=[]. owner=GlobalTx:NodeB-51742:23 11:35:52,570 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Clearing locked keys: [] 11:35:52,570 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) Adding modification PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}. Mod list is null 11:35:52,570 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Committing transaction as it was implicit: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:32 status: ActionStatus.RUNNING > 11:35:52,570 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@17 11:35:52,570 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=-1} 11:35:52,570 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@730c6948] 11:35:52,570 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=-1}, origin null 11:35:52,570 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) Acquiring locks on MagicKey#k2{19/D9F36386/122@NodeB-51742}. 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Await for pending transactions for transaction GlobalTx:NodeB-51742:23 using null 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Locking keys [MagicKey#k2{19/D9F36386/122@NodeB-51742}], no need to check for pending locks. 11:35:52,570 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Registering locked key: MagicKey#k2{19/D9F36386/122@NodeB-51742} 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Lock key=MagicKey#k2{19/D9F36386/122@NodeB-51742} for owner=GlobalTx:NodeB-51742:23. timeout=45000 (MILLISECONDS) 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Acquire lock for GlobalTx:NodeB-51742:23. Timeout=45000 (MILLISECONDS) 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeB-51742:23} 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeB-51742:23}. Current=null 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeB-51742:23}) => true 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeB-51742:23}. WAITING => ACQUIRED 11:35:52,570 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeB-51742:23} successfully acquired the lock. 11:35:52,570 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) *Not* performing local write skew check for key MagicKey#k2{19/D9F36386/122@NodeB-51742} 11:35:52,570 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PrepareCommand 11:35:52,570 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 11:35:52,570 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeB-51742 invoking PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeA-45995, NodeB-51742] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,570 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeB-51742], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,570 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} to addresses [NodeD-43076, NodeA-45995] with response mode GET_ALL 11:35:52,571 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeB-51742: invoking multicast RPC [req-id=1010] 11:35:52,571 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #18, conn_id=0) 11:35:52,571 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 11:35:52,571 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeD-43076: #4, conn_id=2) 11:35:52,571 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,571 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (410 bytes) 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (410 bytes) 11:35:52,569 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (126 bytes (630.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (129 bytes) 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (126 bytes (630.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (129 bytes) 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=11, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,572 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #11, conn_id=3) 11:35:52,572 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#11 11:35:52,572 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,572 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} [sender=NodeA-45995] 11:35:52,572 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,572 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,573 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} 11:35:52,573 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeD-p530-t6) Processing completed transaction GlobalTx:NodeA-45995:22 11:35:52,573 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Removed remote transaction GlobalTx:NodeA-45995:22 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(50298c4a){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,573 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(50298c4a){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} from transaction table. 11:35:52,573 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-threadNodeD-p530-t6) Transaction GlobalTx:NodeA-45995:22 has completed, notifying listening threads. 11:35:52,573 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Marking transaction GlobalTx:NodeA-45995:22 as completed 11:35:52,573 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeD-p530-t6) Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeA-45995:22. Affected keys: [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,573 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-threadNodeD-p530-t6) CommandTopologyId=7, localTopologyId=7 11:35:52,573 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-threadNodeD-p530-t6) Release locks for keys=[]. owner=GlobalTx:NodeA-45995:22 11:35:52,574 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,574 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #4, conn_id=2) 11:35:52,574 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeB-51742#4 11:35:52,574 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1010 11:35:52,574 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} [sender=NodeB-51742] 11:35:52,574 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,574 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-2,NodeD-43076) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,575 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,575 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,575 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeD-p530-t6) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b5b5ed02 11:35:52,575 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeD-p530-t6) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b5b5ed02] 11:35:52,575 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeD-p530-t6) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7}, origin NodeB-51742 11:35:52,575 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeD-p530-t6) Acquiring backup locks on MagicKey#k2{19/D9F36386/122@NodeB-51742}. 11:35:52,575 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Exists in context? null 11:35:52,575 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Retrieved from container null 11:35:52,575 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Creating new entry for key MagicKey#k2{19/D9F36386/122@NodeB-51742} 11:35:52,575 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeD-p530-t6) Adding key MagicKey#k2{19/D9F36386/122@NodeB-51742} to tx GlobalTx:NodeB-51742:23 11:35:52,575 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Updated context entry ReadCommittedEntry(152b082b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,575 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeB-51742 for key 'MagicKey#k2{19/D9F36386/122@NodeB-51742}' 11:35:52,575 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: PutKeyValueCommand 11:35:52,575 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: PrepareCommand 11:35:52,575 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeD-p530-t6) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,575 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeD-p530-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(152b082b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,575 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,575 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 1010 to NodeB-51742 11:35:52,575 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeB-51742: #4, conn_id=2) 11:35:52,575 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,575 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,576 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (78 bytes) 11:35:52,576 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,576 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #4, conn_id=2) 11:35:52,576 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeD-43076#4 11:35:52,572 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #11, conn_id=2) 11:35:52,576 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#11 11:35:52,576 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,576 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} [sender=NodeA-45995] 11:35:52,576 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeC-21874) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,576 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,576 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t6) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeA-45995:22, cacheName=dist} 11:35:52,576 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeC-p458-t6) Processing completed transaction GlobalTx:NodeA-45995:22 11:35:52,576 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeC-p458-t6) Removed remote transaction GlobalTx:NodeA-45995:22 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(6ee6d846){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} 11:35:52,576 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeC-p458-t6) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=ReadCommittedEntry(6ee6d846){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeA-45995:22, state=null} from transaction table. 11:35:52,576 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-threadNodeC-p458-t6) Transaction GlobalTx:NodeA-45995:22 has completed, notifying listening threads. 11:35:52,576 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeC-p458-t6) Marking transaction GlobalTx:NodeA-45995:22 as completed 11:35:52,576 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeC-p458-t6) Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeA-45995:22. Affected keys: [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}] 11:35:52,576 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-threadNodeC-p458-t6) CommandTopologyId=7, localTopologyId=7 11:35:52,576 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-threadNodeC-p458-t6) Release locks for keys=[]. owner=GlobalTx:NodeA-45995:22 11:35:52,572 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 11:35:52,576 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #18, conn_id=0) 11:35:52,576 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#18 11:35:52,576 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1010 11:35:52,577 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} [sender=NodeB-51742] 11:35:52,577 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeA-45995) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,577 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-2,NodeA-45995) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,577 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,577 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,578 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeA-p406-t5) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b5b5ed02 11:35:52,578 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeA-p406-t5) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b5b5ed02] 11:35:52,578 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeA-p406-t5) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7}, origin NodeB-51742 11:35:52,581 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeA-p406-t5) Acquiring backup locks on MagicKey#k2{19/D9F36386/122@NodeB-51742}. 11:35:52,581 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Exists in context? null 11:35:52,581 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Retrieved from container null 11:35:52,581 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Creating new entry for key MagicKey#k2{19/D9F36386/122@NodeB-51742} 11:35:52,581 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeA-p406-t5) Adding key MagicKey#k2{19/D9F36386/122@NodeB-51742} to tx GlobalTx:NodeB-51742:23 11:35:52,581 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Updated context entry ReadCommittedEntry(56c6cc4b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,587 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) Registering requestor NodeB-51742 for key 'MagicKey#k2{19/D9F36386/122@NodeB-51742}' 11:35:52,587 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeA-p406-t5) Invoking: PutKeyValueCommand 11:35:52,587 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeA-p406-t5) Invoking: PrepareCommand 11:35:52,587 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeA-p406-t5) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,587 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeA-p406-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(56c6cc4b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,587 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,587 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1010 to NodeB-51742 11:35:52,587 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeB-51742: #13, conn_id=1) 11:35:52,587 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,587 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,591 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (78 bytes) 11:35:52,592 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1010, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,592 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #13, conn_id=1) 11:35:52,592 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#13 11:35:52,592 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-3,NodeB-51742) Responses: Responses{ NodeD-43076: sender=NodeD-43076, received=true, suspected=false NodeA-45995: sender=NodeA-45995, received=true, suspected=false} 11:35:52,592 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-3,NodeB-51742) Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} is {NodeA-45995=SuccessfulResponse{responseValue=null} , NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,592 TRACE [org.infinispan.transaction.impl.LocalTransaction] (OOB-3,NodeB-51742) Adding remote locks on [NodeD-43076, NodeA-45995, NodeB-51742]. Remote locks are null 11:35:52,596 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-3,NodeB-51742) Executing invocation handler L1LastChanceInterceptor$$Lambda$295/260693056 with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,596 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeA-45995, NodeB-51742], isMarkedForRollback=false, lockedKeys=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@17. 11:35:52,597 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Committing transaction GlobalTx:NodeB-51742:23 11:35:52,597 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@64a7554e] 11:35:52,597 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=-1}, origin null 11:35:52,598 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (testng) No L1 caches to invalidate for keys [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,598 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 11:35:52,598 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeA-45995, NodeB-51742], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,598 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeB-51742 invoking CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeA-45995, NodeB-51742] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,598 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeB-51742], command=CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,598 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} to addresses [NodeD-43076, NodeA-45995] with response mode GET_ALL 11:35:52,598 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeB-51742: invoking multicast RPC [req-id=1016] 11:35:52,598 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #19, conn_id=0) 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 11:35:52,598 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeD-43076: #5, conn_id=2) 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (119 bytes (595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (122 bytes) 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (119 bytes (595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (122 bytes) 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 11:35:52,598 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #19, conn_id=0) 11:35:52,598 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#19 11:35:52,598 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1016 11:35:52,598 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,598 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} [sender=NodeB-51742] 11:35:52,598 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #5, conn_id=2) 11:35:52,598 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeB-51742#5 11:35:52,598 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeA-45995) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,598 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1016 11:35:52,598 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,598 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} [sender=NodeB-51742] 11:35:52,598 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,598 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,598 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,599 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,599 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeA-p406-t5) About to execute tx command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,599 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeD-p530-t6) About to execute tx command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,599 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeA-p406-t5) Invoked with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b5b5ed02] 11:35:52,599 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeA-p406-t5) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7}, origin NodeB-51742 11:35:52,599 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeD-p530-t6) Invoked with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b5b5ed02] 11:35:52,599 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeA-p406-t5) Remote tx topology id 7 and command topology is 7 11:35:52,599 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeD-p530-t6) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7}, origin NodeB-51742 11:35:52,599 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeD-p530-t6) Remote tx topology id 7 and command topology is 7 11:35:52,599 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) Registering requestor NodeB-51742 for key 'MagicKey#k2{19/D9F36386/122@NodeB-51742}' 11:35:52,599 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) No L1 caches to invalidate for keys [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,599 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeA-p406-t5) Invoking: CommitCommand 11:35:52,599 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeB-51742 for key 'MagicKey#k2{19/D9F36386/122@NodeB-51742}' 11:35:52,599 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeA-p406-t5) About to commit entry ReadCommittedEntry(56c6cc4b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,599 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeA-p406-t5) Trying to commit. Key=MagicKey#k2{19/D9F36386/122@NodeB-51742}. Operation Flag=null, L1 invalidation=false 11:35:52,599 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeA-p406-t5) Committing key=MagicKey#k2{19/D9F36386/122@NodeB-51742}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,599 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeA-p406-t5) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v2 11:35:52,599 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeA-p406-t5) Store ImmortalCacheEntry{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2} in container 11:35:52,599 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeA-p406-t5) Sending additional invalidation for requestors if necessary. 11:35:52,599 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) Registering requestor NodeB-51742 for key 'MagicKey#k2{19/D9F36386/122@NodeB-51742}' 11:35:52,599 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) No L1 caches to invalidate for keys [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,599 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeA-p406-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(56c6cc4b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,599 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,599 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1016 to NodeB-51742 11:35:52,599 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeB-51742: #14, conn_id=1) 11:35:52,599 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,599 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,599 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (80 bytes) 11:35:52,599 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) No L1 caches to invalidate for keys [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,605 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,605 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #14, conn_id=1) 11:35:52,605 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#14 11:35:52,605 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: CommitCommand 11:35:52,605 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeD-p530-t6) About to commit entry ReadCommittedEntry(152b082b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,607 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeD-p530-t6) Trying to commit. Key=MagicKey#k2{19/D9F36386/122@NodeB-51742}. Operation Flag=null, L1 invalidation=false 11:35:52,607 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeD-p530-t6) Committing key=MagicKey#k2{19/D9F36386/122@NodeB-51742}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,612 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeD-p530-t6) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v2 11:35:52,612 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeD-p530-t6) Store ImmortalCacheEntry{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2} in container 11:35:52,612 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeD-p530-t6) Sending additional invalidation for requestors if necessary. 11:35:52,612 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeB-51742 for key 'MagicKey#k2{19/D9F36386/122@NodeB-51742}' 11:35:52,612 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) No L1 caches to invalidate for keys [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,612 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeD-p530-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(152b082b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,612 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,614 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 1016 to NodeB-51742 11:35:52,614 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeB-51742: #5, conn_id=2) 11:35:52,624 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,624 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,624 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (80 bytes) 11:35:52,624 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1016, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,624 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #5, conn_id=2) 11:35:52,624 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeD-43076#5 11:35:52,624 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-3,NodeB-51742) Responses: Responses{ NodeD-43076: sender=NodeD-43076value=SuccessfulResponse{responseValue=null} , received=true, suspected=false NodeA-45995: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,624 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-3,NodeB-51742) Response(s) to CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} is {NodeA-45995=SuccessfulResponse{responseValue=null} , NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,625 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-3,NodeB-51742) Executing invocation handler EntryWrappingInterceptor$$Lambda$103/2071385989 with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,625 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (OOB-3,NodeB-51742) About to commit entry ReadCommittedEntry(273a948){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,625 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-3,NodeB-51742) Trying to commit. Key=MagicKey#k2{19/D9F36386/122@NodeB-51742}. Operation Flag=null, L1 invalidation=false 11:35:52,625 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-3,NodeB-51742) Committing key=MagicKey#k2{19/D9F36386/122@NodeB-51742}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,625 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-3,NodeB-51742) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v2 11:35:52,625 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-3,NodeB-51742) Store ImmortalCacheEntry{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2} in container 11:35:52,625 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-3,NodeB-51742) Executing invocation handler L1LastChanceInterceptor$$Lambda$301/976075877 with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,625 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (OOB-3,NodeB-51742) Sending additional invalidation for requestors if necessary. 11:35:52,625 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (OOB-3,NodeB-51742) No L1 caches to invalidate for keys [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,625 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-3,NodeB-51742) Executing invocation handler NotificationInterceptor$1 with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,625 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-3,NodeB-51742) Executing invocation handler AbstractTxLockingInterceptor$$Lambda$302/632765933 with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,625 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (OOB-3,NodeB-51742) Release locks for keys=[MagicKey#k2{19/D9F36386/122@NodeB-51742}]. owner=GlobalTx:NodeB-51742:23 11:35:52,628 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-3,NodeB-51742) Release lock for GlobalTx:NodeB-51742:23. 11:35:52,632 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-3,NodeB-51742) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeB-51742:23}. ACQUIRED => RELEASED 11:35:52,632 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-3,NodeB-51742) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeB-51742:23}? true 11:35:52,636 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-3,NodeB-51742) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeB-51742:23} 11:35:52,636 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-3,NodeB-51742) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeB-51742:23}, null) => true 11:35:52,636 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-3,NodeB-51742) Try acquire. Next in queue=null. Current=null 11:35:52,636 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (OOB-3,NodeB-51742) Clearing locked keys: [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,636 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-3,NodeB-51742) Executing invocation handler TxInterceptor$$Lambda$304/10629423 with command CommitCommand {gtx=GlobalTx:NodeB-51742:23, cacheName='dist', topologyId=7} 11:35:52,636 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Removed LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeA-45995, NodeB-51742], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@17 from transaction table. 11:35:52,636 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Transaction GlobalTx:NodeB-51742:23 has completed, notifying listening threads. 11:35:52,636 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Committed in onePhase? false isOptimistic? true 11:35:52,636 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeA-45995, NodeB-51742], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,636 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) About to invoke tx completion notification on commitNodes: [NodeD-43076, NodeA-45995, NodeB-51742] 11:35:52,636 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeB-51742 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} to recipient list [NodeD-43076, NodeA-45995, NodeB-51742] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,636 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Topology id missing on command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} , setting it to 7 11:35:52,636 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeB-51742], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} , mode=ASYNCHRONOUS, timeout=60000 11:35:52,636 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} to addresses [NodeD-43076, NodeA-45995] with response mode GET_NONE 11:35:52,636 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeA-45995: #20, conn_id=0) 11:35:52,636 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 11:35:52,636 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeB-51742 --> DATA(NodeD-43076: #6, conn_id=2) 11:35:52,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (126 bytes (630.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,636 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (129 bytes) 11:35:52,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (126 bytes (630.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,636 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (129 bytes) 11:35:52,636 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} is {} 11:35:52,636 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,636 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #6, conn_id=2) 11:35:52,636 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeB-51742#6 11:35:52,636 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,636 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} [sender=NodeB-51742] 11:35:52,637 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,637 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,637 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} 11:35:52,637 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 11:35:52,637 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #20, conn_id=0) 11:35:52,637 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#20 11:35:52,637 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,637 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeD-p530-t6) Processing completed transaction GlobalTx:NodeB-51742:23 11:35:52,637 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} [sender=NodeB-51742] 11:35:52,639 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeA-45995) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,642 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeB-51742:23, cacheName=dist} 11:35:52,642 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeA-p406-t5) Processing completed transaction GlobalTx:NodeB-51742:23 11:35:52,642 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeA-p406-t5) Removed remote transaction GlobalTx:NodeB-51742:23 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(56c6cc4b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,642 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeA-p406-t5) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(56c6cc4b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} from transaction table. 11:35:52,642 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-threadNodeA-p406-t5) Transaction GlobalTx:NodeB-51742:23 has completed, notifying listening threads. 11:35:52,642 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeA-p406-t5) Marking transaction GlobalTx:NodeB-51742:23 as completed 11:35:52,642 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeA-p406-t5) Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeB-51742:23. Affected keys: [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,636 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Implicit transaction started! Transaction: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:34 status: ActionStatus.RUNNING > 11:35:52,647 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@18 11:35:52,649 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@32aa55ed] 11:35:52,649 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, origin null 11:35:52,649 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:52,642 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-threadNodeA-p406-t5) CommandTopologyId=7, localTopologyId=7 11:35:52,642 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,639 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Removed remote transaction GlobalTx:NodeB-51742:23 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(152b082b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} 11:35:52,649 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k2{19/D9F36386/122@NodeB-51742}=ReadCommittedEntry(152b082b){key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{19/D9F36386/122@NodeB-51742}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeB-51742:23, state=null} from transaction table. 11:35:52,649 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-threadNodeD-p530-t6) Transaction GlobalTx:NodeB-51742:23 has completed, notifying listening threads. 11:35:52,649 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Marking transaction GlobalTx:NodeB-51742:23 as completed 11:35:52,649 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-threadNodeA-p406-t5) Release locks for keys=[]. owner=GlobalTx:NodeB-51742:23 11:35:52,649 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container null 11:35:52,651 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Creating new entry for key MagicKey#k3{1A/92BE3B55/33@NodeC-21874} 11:35:52,651 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Updated context entry ReadCommittedEntry(4722436d){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,653 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PutKeyValueCommand 11:35:52,653 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (testng) The return value is null 11:35:52,649 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeD-p530-t6) Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeB-51742:23. Affected keys: [MagicKey#k2{19/D9F36386/122@NodeB-51742}] 11:35:52,657 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-threadNodeD-p530-t6) CommandTopologyId=7, localTopologyId=7 11:35:52,657 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-threadNodeD-p530-t6) Release locks for keys=[]. owner=GlobalTx:NodeB-51742:23 11:35:52,653 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Release locks for keys=[]. owner=GlobalTx:NodeC-21874:24 11:35:52,658 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Clearing locked keys: [] 11:35:52,658 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) Adding modification PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}. Mod list is null 11:35:52,658 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Committing transaction as it was implicit: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:34 status: ActionStatus.RUNNING > 11:35:52,658 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@18 11:35:52,658 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=-1} 11:35:52,658 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@aea9eda] 11:35:52,658 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=-1}, origin null 11:35:52,658 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) Acquiring locks on MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. 11:35:52,658 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Await for pending transactions for transaction GlobalTx:NodeC-21874:24 using null 11:35:52,661 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Locking keys [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], no need to check for pending locks. 11:35:52,666 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Registering locked key: MagicKey#k3{1A/92BE3B55/33@NodeC-21874} 11:35:52,671 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Lock key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874} for owner=GlobalTx:NodeC-21874:24. timeout=45000 (MILLISECONDS) 11:35:52,671 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Acquire lock for GlobalTx:NodeC-21874:24. Timeout=45000 (MILLISECONDS) 11:35:52,671 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeC-21874:24} 11:35:52,671 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeC-21874:24}. Current=null 11:35:52,671 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeC-21874:24}) => true 11:35:52,671 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeC-21874:24}. WAITING => ACQUIRED 11:35:52,671 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeC-21874:24} successfully acquired the lock. 11:35:52,671 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) *Not* performing local write skew check for key MagicKey#k3{1A/92BE3B55/33@NodeC-21874} 11:35:52,671 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PrepareCommand 11:35:52,671 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 11:35:52,671 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeC-21874 invoking PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeC-21874, NodeB-51742] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,671 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeC-21874, NodeB-51742], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,671 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} to addresses [NodeD-43076, NodeB-51742] with response mode GET_ALL 11:35:52,672 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeC-21874: invoking multicast RPC [req-id=1027] 11:35:52,672 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeB-51742: #4, conn_id=1) 11:35:52,672 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,672 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeD-43076: #4, conn_id=2) 11:35:52,672 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,672 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,672 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (410 bytes) 11:35:52,672 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,672 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeC-21874: #4, conn_id=1) 11:35:52,672 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeC-21874#4 11:35:52,672 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1027 11:35:52,672 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} [sender=NodeC-21874] 11:35:52,672 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-3,NodeB-51742) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,672 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,672 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-3,NodeB-51742) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,672 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,672 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,672 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeB-p415-t5) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@af0ec38a 11:35:52,672 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeB-p415-t5) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@af0ec38a] 11:35:52,672 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeB-p415-t5) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7}, origin NodeC-21874 11:35:52,673 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (410 bytes) 11:35:52,673 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeB-p415-t5) Acquiring backup locks on MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. 11:35:52,673 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeB-p415-t5) Exists in context? null 11:35:52,673 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeB-p415-t5) Retrieved from container null 11:35:52,673 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeB-p415-t5) Creating new entry for key MagicKey#k3{1A/92BE3B55/33@NodeC-21874} 11:35:52,673 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeB-p415-t5) Adding key MagicKey#k3{1A/92BE3B55/33@NodeC-21874} to tx GlobalTx:NodeC-21874:24 11:35:52,673 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeB-p415-t5) Updated context entry ReadCommittedEntry(6577ebed){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,673 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeB-p415-t5) Registering requestor NodeC-21874 for key 'MagicKey#k3{1A/92BE3B55/33@NodeC-21874}' 11:35:52,673 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeB-p415-t5) Invoking: PutKeyValueCommand 11:35:52,673 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeB-p415-t5) Invoking: PrepareCommand 11:35:52,673 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeB-p415-t5) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,673 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeB-p415-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(6577ebed){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,673 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,673 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1027 to NodeC-21874 11:35:52,673 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeC-21874: #4, conn_id=1) 11:35:52,673 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeC-21874, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,673 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,673 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #4, conn_id=2) 11:35:52,673 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeC-21874#4 11:35:52,673 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1027 11:35:52,673 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} [sender=NodeC-21874] 11:35:52,673 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,673 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-2,NodeD-43076) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,673 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,673 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,673 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeD-p530-t6) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@af0ec38a 11:35:52,673 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeD-p530-t6) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@af0ec38a] 11:35:52,673 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeD-p530-t6) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7}, origin NodeC-21874 11:35:52,674 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeD-p530-t6) Acquiring backup locks on MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. 11:35:52,674 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Exists in context? null 11:35:52,674 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Retrieved from container null 11:35:52,674 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Creating new entry for key MagicKey#k3{1A/92BE3B55/33@NodeC-21874} 11:35:52,674 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeD-p530-t6) Adding key MagicKey#k3{1A/92BE3B55/33@NodeC-21874} to tx GlobalTx:NodeC-21874:24 11:35:52,674 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeD-p530-t6) Updated context entry ReadCommittedEntry(4096d583){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,674 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeC-21874 for key 'MagicKey#k3{1A/92BE3B55/33@NodeC-21874}' 11:35:52,674 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: PutKeyValueCommand 11:35:52,674 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: PrepareCommand 11:35:52,674 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeD-p530-t6) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,674 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeD-p530-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(4096d583){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,674 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,674 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 1027 to NodeC-21874 11:35:52,674 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeC-21874: #4, conn_id=1) 11:35:52,674 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,673 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,674 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8302 (78 bytes) 11:35:52,674 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeB-51742 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,674 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeB-51742: #4, conn_id=1) 11:35:52,674 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeB-51742#4 11:35:52,674 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,674 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (78 bytes) 11:35:52,674 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1027, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,674 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #4, conn_id=1) 11:35:52,675 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeD-43076#4 11:35:52,675 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: Responses{ NodeD-43076: sender=NodeD-43076, received=true, suspected=false NodeB-51742: sender=NodeB-51742, received=true, suspected=false} 11:35:52,675 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeC-21874) Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} is {NodeB-51742=SuccessfulResponse{responseValue=null} , NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,675 TRACE [org.infinispan.transaction.impl.LocalTransaction] (OOB-1,NodeC-21874) Adding remote locks on [NodeD-43076, NodeC-21874, NodeB-51742]. Remote locks are null 11:35:52,675 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-1,NodeC-21874) Executing invocation handler L1LastChanceInterceptor$$Lambda$295/260693056 with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,675 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeC-21874, NodeB-51742], isMarkedForRollback=false, lockedKeys=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@18. 11:35:52,675 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Committing transaction GlobalTx:NodeC-21874:24 11:35:52,675 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@433a2206] 11:35:52,675 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=-1}, origin null 11:35:52,675 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (testng) No L1 caches to invalidate for keys [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,675 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 11:35:52,675 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeC-21874, NodeB-51742], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,675 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeC-21874 invoking CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeC-21874, NodeB-51742] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,675 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeC-21874, NodeB-51742], command=CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,675 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} to addresses [NodeD-43076, NodeB-51742] with response mode GET_ALL 11:35:52,675 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeC-21874: invoking multicast RPC [req-id=1029] 11:35:52,675 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeB-51742: #5, conn_id=1) 11:35:52,675 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,675 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeD-43076: #5, conn_id=2) 11:35:52,675 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,675 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (119 bytes (595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,675 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (122 bytes) 11:35:52,676 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,676 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeC-21874: #5, conn_id=1) 11:35:52,676 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeC-21874#5 11:35:52,676 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1029 11:35:52,676 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} [sender=NodeC-21874] 11:35:52,676 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-3,NodeB-51742) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,676 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,675 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (119 bytes (595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,676 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (122 bytes) 11:35:52,676 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,676 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #5, conn_id=2) 11:35:52,676 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeC-21874#5 11:35:52,676 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,677 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeB-p415-t5) About to execute tx command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,677 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeB-p415-t5) Invoked with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@af0ec38a] 11:35:52,680 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeB-p415-t5) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7}, origin NodeC-21874 11:35:52,680 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeB-p415-t5) Remote tx topology id 7 and command topology is 7 11:35:52,680 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeB-p415-t5) Registering requestor NodeC-21874 for key 'MagicKey#k3{1A/92BE3B55/33@NodeC-21874}' 11:35:52,680 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeB-p415-t5) No L1 caches to invalidate for keys [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,680 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeB-p415-t5) Invoking: CommitCommand 11:35:52,680 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeB-p415-t5) About to commit entry ReadCommittedEntry(6577ebed){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,677 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1029 11:35:52,680 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} [sender=NodeC-21874] 11:35:52,680 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,680 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,681 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,681 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeD-p530-t6) About to execute tx command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,681 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeD-p530-t6) Invoked with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@af0ec38a] 11:35:52,681 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeD-p530-t6) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7}, origin NodeC-21874 11:35:52,681 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeD-p530-t6) Remote tx topology id 7 and command topology is 7 11:35:52,681 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeC-21874 for key 'MagicKey#k3{1A/92BE3B55/33@NodeC-21874}' 11:35:52,681 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) No L1 caches to invalidate for keys [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,680 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeB-p415-t5) Trying to commit. Key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. Operation Flag=null, L1 invalidation=false 11:35:52,681 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeB-p415-t5) Committing key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,681 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeB-p415-t5) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v3 11:35:52,681 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeB-p415-t5) Store ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} in container 11:35:52,681 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeB-p415-t5) Sending additional invalidation for requestors if necessary. 11:35:52,681 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeB-p415-t5) Registering requestor NodeC-21874 for key 'MagicKey#k3{1A/92BE3B55/33@NodeC-21874}' 11:35:52,681 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeB-p415-t5) No L1 caches to invalidate for keys [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,681 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeB-p415-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(6577ebed){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,681 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,681 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeD-p530-t6) Invoking: CommitCommand 11:35:52,685 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeD-p530-t6) About to commit entry ReadCommittedEntry(4096d583){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,685 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeD-p530-t6) Trying to commit. Key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. Operation Flag=null, L1 invalidation=false 11:35:52,685 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeD-p530-t6) Committing key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,685 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeD-p530-t6) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v3 11:35:52,685 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeD-p530-t6) Store ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} in container 11:35:52,685 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeD-p530-t6) Sending additional invalidation for requestors if necessary. 11:35:52,685 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1029 to NodeC-21874 11:35:52,685 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeC-21874: #5, conn_id=1) 11:35:52,685 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) Registering requestor NodeC-21874 for key 'MagicKey#k3{1A/92BE3B55/33@NodeC-21874}' 11:35:52,685 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeD-p530-t6) No L1 caches to invalidate for keys [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,685 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeD-p530-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(4096d583){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,685 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,685 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 1029 to NodeC-21874 11:35:52,685 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeC-21874: #5, conn_id=1) 11:35:52,685 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeC-21874, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,686 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,686 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8302 (80 bytes) 11:35:52,686 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,686 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,686 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (80 bytes) 11:35:52,686 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,686 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #5, conn_id=1) 11:35:52,686 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeD-43076#5 11:35:52,690 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeB-51742 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1029, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,690 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeB-51742: #5, conn_id=1) 11:35:52,693 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeB-51742#5 11:35:52,693 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: Responses{ NodeD-43076: sender=NodeD-43076value=SuccessfulResponse{responseValue=null} , received=true, suspected=false NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,693 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeC-21874) Response(s) to CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} is {NodeB-51742=SuccessfulResponse{responseValue=null} , NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,693 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-1,NodeC-21874) Executing invocation handler EntryWrappingInterceptor$$Lambda$103/2071385989 with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,693 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (OOB-1,NodeC-21874) About to commit entry ReadCommittedEntry(4722436d){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,693 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-1,NodeC-21874) Trying to commit. Key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. Operation Flag=null, L1 invalidation=false 11:35:52,693 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-1,NodeC-21874) Committing key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,693 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-1,NodeC-21874) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v3 11:35:52,693 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-1,NodeC-21874) Store ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} in container 11:35:52,693 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-1,NodeC-21874) Executing invocation handler L1LastChanceInterceptor$$Lambda$301/976075877 with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,693 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (OOB-1,NodeC-21874) Sending additional invalidation for requestors if necessary. 11:35:52,693 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (OOB-1,NodeC-21874) No L1 caches to invalidate for keys [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,693 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-1,NodeC-21874) Executing invocation handler NotificationInterceptor$1 with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,693 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-1,NodeC-21874) Executing invocation handler AbstractTxLockingInterceptor$$Lambda$302/632765933 with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,693 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (OOB-1,NodeC-21874) Release locks for keys=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}]. owner=GlobalTx:NodeC-21874:24 11:35:52,696 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-1,NodeC-21874) Release lock for GlobalTx:NodeC-21874:24. 11:35:52,699 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-1,NodeC-21874) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeC-21874:24}. ACQUIRED => RELEASED 11:35:52,700 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-1,NodeC-21874) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeC-21874:24}? true 11:35:52,709 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-1,NodeC-21874) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeC-21874:24} 11:35:52,709 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-1,NodeC-21874) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeC-21874:24}, null) => true 11:35:52,709 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-1,NodeC-21874) Try acquire. Next in queue=null. Current=null 11:35:52,709 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (OOB-1,NodeC-21874) Clearing locked keys: [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,710 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-1,NodeC-21874) Executing invocation handler TxInterceptor$$Lambda$304/10629423 with command CommitCommand {gtx=GlobalTx:NodeC-21874:24, cacheName='dist', topologyId=7} 11:35:52,710 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Removed LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeC-21874, NodeB-51742], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@18 from transaction table. 11:35:52,710 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Transaction GlobalTx:NodeC-21874:24 has completed, notifying listening threads. 11:35:52,710 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Committed in onePhase? false isOptimistic? true 11:35:52,711 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeC-21874, NodeB-51742], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,711 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) About to invoke tx completion notification on commitNodes: [NodeD-43076, NodeC-21874, NodeB-51742] 11:35:52,711 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeC-21874 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} to recipient list [NodeD-43076, NodeC-21874, NodeB-51742] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,711 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Topology id missing on command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} , setting it to 7 11:35:52,711 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeC-21874, NodeB-51742], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} , mode=ASYNCHRONOUS, timeout=60000 11:35:52,711 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} to addresses [NodeD-43076, NodeB-51742] with response mode GET_NONE 11:35:52,711 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeB-51742: #6, conn_id=1) 11:35:52,711 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,711 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeD-43076: #6, conn_id=2) 11:35:52,711 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,711 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} is {} 11:35:52,711 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Implicit transaction started! Transaction: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:36 status: ActionStatus.RUNNING > 11:35:52,711 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@19 11:35:52,711 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@1cae58aa] 11:35:52,711 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 2 msgs (252 bytes (1260.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeD-43076, ISPN:NodeB-51742] 11:35:52,711 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}, origin null 11:35:52,711 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (129 bytes) 11:35:52,711 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:52,711 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container null 11:35:52,711 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Creating new entry for key MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} 11:35:52,711 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Updated context entry ReadCommittedEntry(67ca4c30){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,711 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PutKeyValueCommand 11:35:52,711 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (testng) The return value is null 11:35:52,711 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,711 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #6, conn_id=2) 11:35:52,711 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeC-21874#6 11:35:52,714 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,714 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} [sender=NodeC-21874] 11:35:52,711 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Release locks for keys=[]. owner=GlobalTx:NodeD-43076:25 11:35:52,711 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (129 bytes) 11:35:52,715 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,715 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeC-21874: #6, conn_id=1) 11:35:52,715 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeC-21874#6 11:35:52,715 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,715 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} [sender=NodeC-21874] 11:35:52,715 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-3,NodeB-51742) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,715 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,715 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} 11:35:52,715 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeB-p415-t5) Processing completed transaction GlobalTx:NodeC-21874:24 11:35:52,715 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeB-p415-t5) Removed remote transaction GlobalTx:NodeC-21874:24 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(6577ebed){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,715 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeB-p415-t5) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(6577ebed){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} from transaction table. 11:35:52,714 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Clearing locked keys: [] 11:35:52,714 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeD-43076) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,716 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeC-21874:24, cacheName=dist} 11:35:52,716 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeD-p530-t6) Processing completed transaction GlobalTx:NodeC-21874:24 11:35:52,716 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Removed remote transaction GlobalTx:NodeC-21874:24 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(4096d583){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} 11:35:52,716 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) Adding modification PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}. Mod list is null 11:35:52,716 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=ReadCommittedEntry(4096d583){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k3{1A/92BE3B55/33@NodeC-21874}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeC-21874:24, state=null} from transaction table. 11:35:52,716 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,715 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-threadNodeB-p415-t5) Transaction GlobalTx:NodeC-21874:24 has completed, notifying listening threads. 11:35:52,717 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeB-p415-t5) Marking transaction GlobalTx:NodeC-21874:24 as completed 11:35:52,716 TRACE [org.infinispan.cache.impl.CacheImpl] (testng) Committing transaction as it was implicit: TransactionImple < ac, BasicAction: 0:ffff0a2804a8:a8ad:58088ff4:36 status: ActionStatus.RUNNING > 11:35:52,717 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@19 11:35:52,716 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-threadNodeD-p530-t6) Transaction GlobalTx:NodeC-21874:24 has completed, notifying listening threads. 11:35:52,717 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeD-p530-t6) Marking transaction GlobalTx:NodeC-21874:24 as completed 11:35:52,717 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeD-p530-t6) Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeC-21874:24. Affected keys: [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,717 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-threadNodeD-p530-t6) CommandTopologyId=7, localTopologyId=7 11:35:52,717 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-threadNodeD-p530-t6) Release locks for keys=[]. owner=GlobalTx:NodeC-21874:24 11:35:52,717 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=-1} 11:35:52,722 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@2f23a3b1] 11:35:52,722 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=-1}, origin null 11:35:52,722 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeC-21874) NodeC-21874 --> ACK(NodeD-43076: #5) 11:35:52,725 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeC-21874) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=5, TP: [cluster_name=ISPN] 11:35:52,725 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,725 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (63 bytes) 11:35:52,717 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeB-p415-t5) Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeC-21874:24. Affected keys: [MagicKey#k3{1A/92BE3B55/33@NodeC-21874}] 11:35:52,725 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-threadNodeB-p415-t5) CommandTopologyId=7, localTopologyId=7 11:35:52,725 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-threadNodeB-p415-t5) Release locks for keys=[]. owner=GlobalTx:NodeC-21874:24 11:35:52,725 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=5, TP: [cluster_name=ISPN] 11:35:52,725 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeC-21874) NodeC-21874 --> ACK(NodeA-45995: #11) 11:35:52,725 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) Acquiring locks on MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Await for pending transactions for transaction GlobalTx:NodeD-43076:25 using null 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (testng) Locking keys [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], no need to check for pending locks. 11:35:52,726 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Registering locked key: MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (testng) Lock key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} for owner=GlobalTx:NodeD-43076:25. timeout=45000 (MILLISECONDS) 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Acquire lock for GlobalTx:NodeD-43076:25. Timeout=45000 (MILLISECONDS) 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeD-43076:25} 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeD-43076:25}. Current=null 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:NodeD-43076:25}) => true 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeD-43076:25}. WAITING => ACQUIRED 11:35:52,726 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (testng) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:NodeD-43076:25} successfully acquired the lock. 11:35:52,726 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (testng) *Not* performing local write skew check for key MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} 11:35:52,726 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: PrepareCommand 11:35:52,726 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 11:35:52,726 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeD-43076 invoking PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeA-45995, NodeC-21874] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,728 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeC-21874], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,730 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeD-43076) NodeD-43076 <-- ACK(NodeC-21874: #5, conn-id=1, ts=5) 11:35:52,728 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} to addresses [NodeA-45995, NodeC-21874] with response mode GET_ALL 11:35:52,728 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeC-21874) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are UNICAST3: ACK, seqno=11, conn_id=2, ts=6, TP: [cluster_name=ISPN] 11:35:52,731 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeC-21874) NodeC-21874 --> ACK(NodeB-51742: #5) 11:35:52,731 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeC-21874) NodeC-21874: sending msg to NodeB-51742, src=NodeC-21874, headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=7, TP: [cluster_name=ISPN] 11:35:52,731 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,731 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (63 bytes) 11:35:52,731 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeD-43076: invoking multicast RPC [req-id=1048] 11:35:52,731 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,731 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeC-21874: #6, conn_id=1) 11:35:52,731 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8301 (63 bytes) 11:35:52,731 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,733 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeC-21874 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=7, TP: [cluster_name=ISPN] 11:35:52,733 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742 <-- ACK(NodeC-21874: #5, conn-id=1, ts=7) 11:35:52,733 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=11, conn_id=2, ts=6, TP: [cluster_name=ISPN] 11:35:52,734 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- ACK(NodeC-21874: #11, conn-id=2, ts=6) 11:35:52,731 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,734 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (410 bytes) 11:35:52,731 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #14, conn_id=0) 11:35:52,734 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 11:35:52,734 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,734 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #6, conn_id=1) 11:35:52,734 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeD-43076#6 11:35:52,734 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (407 bytes (2035.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,734 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (410 bytes) 11:35:52,735 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=334 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 11:35:52,735 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #14, conn_id=0) 11:35:52,735 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#14 11:35:52,735 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1048 11:35:52,735 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} [sender=NodeD-43076] 11:35:52,735 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeA-45995) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,734 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1048 11:35:52,736 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute CacheRpcCommand: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} [sender=NodeD-43076] 11:35:52,735 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-2,NodeA-45995) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} 11:35:52,740 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,740 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,740 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeA-p406-t5) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@3670116c 11:35:52,740 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeA-p406-t5) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@3670116c] 11:35:52,736 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeC-21874) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,742 TRACE [org.infinispan.transaction.impl.TransactionTable] (OOB-1,NodeC-21874) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} 11:35:52,742 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,742 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t6) Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,742 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-threadNodeC-p458-t6) Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@3670116c 11:35:52,742 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeC-p458-t6) Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@3670116c] 11:35:52,742 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeC-p458-t6) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7}, origin NodeD-43076 11:35:52,742 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeC-p458-t6) Acquiring backup locks on MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. 11:35:52,742 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Exists in context? null 11:35:52,742 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Retrieved from container null 11:35:52,742 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Creating new entry for key MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} 11:35:52,742 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeC-p458-t6) Adding key MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} to tx GlobalTx:NodeD-43076:25 11:35:52,742 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeC-p458-t6) Updated context entry ReadCommittedEntry(c3e3a2d){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,741 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeA-p406-t5) handleTxCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7}, origin NodeD-43076 11:35:52,743 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-threadNodeA-p406-t5) Acquiring backup locks on MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. 11:35:52,743 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Exists in context? null 11:35:52,743 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Retrieved from container null 11:35:52,743 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Creating new entry for key MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} 11:35:52,743 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-threadNodeA-p406-t5) Adding key MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076} to tx GlobalTx:NodeD-43076:25 11:35:52,743 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-threadNodeA-p406-t5) Updated context entry ReadCommittedEntry(15cc7a7c){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,743 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) Registering requestor NodeD-43076 for key 'MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}' 11:35:52,743 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeA-p406-t5) Invoking: PutKeyValueCommand 11:35:52,743 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeA-p406-t5) Invoking: PrepareCommand 11:35:52,743 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeA-p406-t5) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,743 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeA-p406-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}=ReadCommittedEntry(15cc7a7c){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} 11:35:52,743 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,743 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1048 to NodeD-43076 11:35:52,743 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #12, conn_id=3) 11:35:52,743 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,743 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,743 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (78 bytes) 11:35:52,743 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,743 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #12, conn_id=3) 11:35:52,743 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#12 11:35:52,742 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) Registering requestor NodeD-43076 for key 'MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}' 11:35:52,745 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeC-p458-t6) Invoking: PutKeyValueCommand 11:35:52,745 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeC-p458-t6) Invoking: PrepareCommand 11:35:52,745 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeC-p458-t6) Verifying transaction: originatorMissing=false, alreadyCompleted=false 11:35:52,745 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeC-p458-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}=ReadCommittedEntry(c3e3a2d){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} 11:35:52,745 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,745 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 1048 to NodeD-43076 11:35:52,745 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeD-43076: #7, conn_id=2) 11:35:52,745 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,745 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,748 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (78 bytes) 11:35:52,748 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1048, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,750 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #7, conn_id=2) 11:35:52,750 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeC-21874#7 11:35:52,752 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeD-43076) Responses: Responses{ NodeA-45995: sender=NodeA-45995, received=true, suspected=false NodeC-21874: sender=NodeC-21874, received=true, suspected=false} 11:35:52,762 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeD-43076) Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} is {NodeC-21874=SuccessfulResponse{responseValue=null} , NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,762 TRACE [org.infinispan.transaction.impl.LocalTransaction] (OOB-2,NodeD-43076) Adding remote locks on [NodeD-43076, NodeA-45995, NodeC-21874]. Remote locks are null 11:35:52,762 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeD-43076) Executing invocation handler L1LastChanceInterceptor$$Lambda$295/260693056 with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,762 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeA-45995, NodeC-21874], isMarkedForRollback=false, lockedKeys=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@19. 11:35:52,762 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (testng) Committing transaction GlobalTx:NodeD-43076:25 11:35:52,762 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6ce0790b] 11:35:52,762 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (testng) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=-1}, origin null 11:35:52,762 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (testng) No L1 caches to invalidate for keys [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,766 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (testng) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 11:35:52,766 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeA-45995, NodeC-21874], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,766 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeD-43076 invoking CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} to recipient list [NodeD-43076, NodeA-45995, NodeC-21874] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,766 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeC-21874], command=CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 11:35:52,766 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} to addresses [NodeA-45995, NodeC-21874] with response mode GET_ALL 11:35:52,766 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeD-43076: invoking multicast RPC [req-id=1063] 11:35:52,766 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeC-21874: #7, conn_id=1) 11:35:52,766 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,766 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #15, conn_id=0) 11:35:52,766 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 11:35:52,766 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 2 msgs (238 bytes (1190.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeA-45995] 11:35:52,766 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (122 bytes) 11:35:52,766 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (122 bytes) 11:35:52,767 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 11:35:52,767 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #15, conn_id=0) 11:35:52,767 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#15 11:35:52,767 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1063 11:35:52,767 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} [sender=NodeD-43076] 11:35:52,767 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeA-45995) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,767 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,767 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,767 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeA-p406-t5) About to execute tx command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,767 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeA-p406-t5) Invoked with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@3670116c] 11:35:52,767 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeA-p406-t5) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7}, origin NodeD-43076 11:35:52,767 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeA-p406-t5) Remote tx topology id 7 and command topology is 7 11:35:52,767 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) Registering requestor NodeD-43076 for key 'MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}' 11:35:52,767 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) No L1 caches to invalidate for keys [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,767 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeA-p406-t5) Invoking: CommitCommand 11:35:52,767 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeA-p406-t5) About to commit entry ReadCommittedEntry(15cc7a7c){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,767 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeA-p406-t5) Trying to commit. Key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. Operation Flag=null, L1 invalidation=false 11:35:52,767 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeA-p406-t5) Committing key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,767 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeA-p406-t5) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v4 11:35:52,767 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeA-p406-t5) Store ImmortalCacheEntry{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4} in container 11:35:52,767 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeA-p406-t5) Sending additional invalidation for requestors if necessary. 11:35:52,769 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=46 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,769 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #7, conn_id=1) 11:35:52,769 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeD-43076#7 11:35:52,769 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1063 11:35:52,769 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute CacheRpcCommand: CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} [sender=NodeD-43076] 11:35:52,769 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeC-21874) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,769 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,769 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeC-p458-t6) Calling perform() on CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,769 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-threadNodeC-p458-t6) About to execute tx command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,769 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-threadNodeC-p458-t6) Invoked with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@3670116c] 11:35:52,769 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-threadNodeC-p458-t6) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7}, origin NodeD-43076 11:35:52,769 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-threadNodeC-p458-t6) Remote tx topology id 7 and command topology is 7 11:35:52,769 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) Registering requestor NodeD-43076 for key 'MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}' 11:35:52,769 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) No L1 caches to invalidate for keys [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,769 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-threadNodeC-p458-t6) Invoking: CommitCommand 11:35:52,769 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-threadNodeC-p458-t6) About to commit entry ReadCommittedEntry(c3e3a2d){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,769 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeC-p458-t6) Trying to commit. Key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. Operation Flag=null, L1 invalidation=false 11:35:52,769 TRACE [org.infinispan.statetransfer.CommitManager] (remote-threadNodeC-p458-t6) Committing key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,769 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeC-p458-t6) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v4 11:35:52,769 TRACE [org.infinispan.container.DefaultDataContainer] (remote-threadNodeC-p458-t6) Store ImmortalCacheEntry{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4} in container 11:35:52,770 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (remote-threadNodeC-p458-t6) Sending additional invalidation for requestors if necessary. 11:35:52,770 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) Registering requestor NodeD-43076 for key 'MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}' 11:35:52,770 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeC-p458-t6) No L1 caches to invalidate for keys [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,770 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeC-p458-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}=ReadCommittedEntry(c3e3a2d){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} 11:35:52,770 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,770 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 1063 to NodeD-43076 11:35:52,770 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeD-43076: #8, conn_id=2) 11:35:52,770 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,770 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,770 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (80 bytes) 11:35:52,770 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeC-21874 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,770 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeC-21874: #8, conn_id=2) 11:35:52,770 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeC-21874#8 11:35:52,767 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) Registering requestor NodeD-43076 for key 'MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}' 11:35:52,779 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (remote-threadNodeA-p406-t5) No L1 caches to invalidate for keys [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,779 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-threadNodeA-p406-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}=ReadCommittedEntry(15cc7a7c){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} 11:35:52,779 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,779 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1063 to NodeD-43076 11:35:52,779 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #13, conn_id=3) 11:35:52,785 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,785 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,785 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (80 bytes) 11:35:52,785 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1063, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,785 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #13, conn_id=3) 11:35:52,785 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#13 11:35:52,785 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeD-43076) Responses: Responses{ NodeA-45995: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false NodeC-21874: sender=NodeC-21874value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,786 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeD-43076) Response(s) to CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} is {NodeC-21874=SuccessfulResponse{responseValue=null} , NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,786 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeD-43076) Executing invocation handler EntryWrappingInterceptor$$Lambda$103/2071385989 with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,788 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (OOB-2,NodeD-43076) About to commit entry ReadCommittedEntry(67ca4c30){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}} 11:35:52,788 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-2,NodeD-43076) Trying to commit. Key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. Operation Flag=null, L1 invalidation=false 11:35:52,788 TRACE [org.infinispan.statetransfer.CommitManager] (OOB-2,NodeD-43076) Committing key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}. It is a L1 invalidation or a normal put and no tracking is enabled! 11:35:52,788 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-2,NodeD-43076) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, new value=v4 11:35:52,788 TRACE [org.infinispan.container.DefaultDataContainer] (OOB-2,NodeD-43076) Store ImmortalCacheEntry{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4} in container 11:35:52,788 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeD-43076) Executing invocation handler L1LastChanceInterceptor$$Lambda$301/976075877 with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,788 TRACE [org.infinispan.interceptors.distribution.L1NonTxInterceptor] (OOB-2,NodeD-43076) Sending additional invalidation for requestors if necessary. 11:35:52,788 TRACE [org.infinispan.distribution.impl.L1ManagerImpl] (OOB-2,NodeD-43076) No L1 caches to invalidate for keys [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,788 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeD-43076) Executing invocation handler NotificationInterceptor$1 with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,788 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeD-43076) Executing invocation handler AbstractTxLockingInterceptor$$Lambda$302/632765933 with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,788 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (OOB-2,NodeD-43076) Release locks for keys=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}]. owner=GlobalTx:NodeD-43076:25 11:35:52,791 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeD-43076) Release lock for GlobalTx:NodeD-43076:25. 11:35:52,792 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeD-43076) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeD-43076:25}. ACQUIRED => RELEASED 11:35:52,792 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeD-43076) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeD-43076:25}? true 11:35:52,792 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeD-43076) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeD-43076:25} 11:35:52,793 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeD-43076) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:NodeD-43076:25}, null) => true 11:35:52,797 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeD-43076: #15) 11:35:52,794 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (OOB-2,NodeD-43076) Try acquire. Next in queue=null. Current=null 11:35:52,797 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (OOB-2,NodeD-43076) Clearing locked keys: [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,797 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are UNICAST3: ACK, seqno=15, ts=12, TP: [cluster_name=ISPN] 11:35:52,798 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeC-21874: #16) 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are UNICAST3: ACK, seqno=16, ts=13, TP: [cluster_name=ISPN] 11:35:52,798 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeB-51742: #20) 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are UNICAST3: ACK, seqno=20, ts=14, TP: [cluster_name=ISPN] 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 3 msgs (180 bytes (900.00% of max_bundle_size) to 3 dests(s): [ISPN:NodeD-43076, ISPN:NodeC-21874, ISPN:NodeB-51742] 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (63 bytes) 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (63 bytes) 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=16, ts=13, TP: [cluster_name=ISPN] 11:35:52,798 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeC-21874) NodeC-21874 <-- ACK(NodeA-45995: #16, conn-id=0, ts=13) 11:35:52,798 TRACE [org.infinispan.interceptors.impl.AsyncInvocationStage] (OOB-2,NodeD-43076) Executing invocation handler TxInterceptor$$Lambda$304/10629423 with command CommitCommand {gtx=GlobalTx:NodeD-43076:25, cacheName='dist', topologyId=7} 11:35:52,798 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Removed LocalTransaction{remoteLockedNodes=[NodeD-43076, NodeA-45995, NodeC-21874], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=7, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@19 from transaction table. 11:35:52,798 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (testng) Transaction GlobalTx:NodeD-43076:25 has completed, notifying listening threads. 11:35:52,798 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Committed in onePhase? false isOptimistic? true 11:35:52,798 TRACE [org.infinispan.transaction.impl.LocalTransaction] (testng) getCommitNodes recipients=[NodeD-43076, NodeA-45995, NodeC-21874], currentTopologyId=7, members=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], txTopologyId=7 11:35:52,798 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) About to invoke tx completion notification on commitNodes: [NodeD-43076, NodeA-45995, NodeC-21874] 11:35:52,798 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeD-43076 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} to recipient list [NodeD-43076, NodeA-45995, NodeC-21874] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,798 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Topology id missing on command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} , setting it to 7 11:35:52,798 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeD-43076, NodeA-45995, NodeC-21874], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} , mode=ASYNCHRONOUS, timeout=60000 11:35:52,798 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} to addresses [NodeA-45995, NodeC-21874] with response mode GET_NONE 11:35:52,798 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeC-21874: #8, conn_id=1) 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,798 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #16, conn_id=0) 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 11:35:52,799 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} is {} 11:35:52,799 INFO [org.infinispan.distribution.rehash. (testng) Initialized with keys [MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, MagicKey#k2{19/D9F36386/122@NodeB-51742}, MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,799 INFO [org.infinispan.distribution.rehash. (testng) Invoking rehash event 11:35:52,799 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command SizeCommand{} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7b55e8ed] 11:35:52,799 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: SizeCommand 11:35:52,799 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command KeySetCommand{cache=dist} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@a121d17] 11:35:52,799 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: KeySetCommand 11:35:52,799 TRACE [org.infinispan.test.TestingUtil] (testng) Local size on NodeC-21874 before stopping: 3 11:35:52,799 DEBUG [org.infinispan.cache.impl.CacheImpl] (testng) Stopping cache dist on NodeC-21874 11:35:52,800 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Shutting down StateTransferManager of cache dist on node NodeC-21874 11:35:52,800 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Node NodeC-21874 leaving cache dist 11:35:52,800 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=SYNCHRONOUS, timeout=240000 11:35:52,800 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_ALL 11:35:52,800 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeC-21874: invoking unicast RPC [req-id=1080] on NodeA-45995 11:35:52,800 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #17, conn_id=0) 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1080, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 2 msgs (252 bytes (1260.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeA-45995] 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (129 bytes) 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (129 bytes) 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeD-43076 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,800 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeD-43076: #8, conn_id=1) 11:35:52,800 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeD-43076#8 11:35:52,800 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (113 bytes (565.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (116 bytes) 11:35:52,800 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} [sender=NodeD-43076] 11:35:52,800 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Silently ignoring that dist cache is not defined 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=55 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 11:35:52,800 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #16, conn_id=0) 11:35:52,800 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#16 11:35:52,800 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,800 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} [sender=NodeD-43076] 11:35:52,800 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeA-45995) Checking if transaction data was received for topology 7, current topology is 7 11:35:52,800 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,800 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=7, gtx=GlobalTx:NodeD-43076:25, cacheName=dist} 11:35:52,800 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeA-p406-t5) Processing completed transaction GlobalTx:NodeD-43076:25 11:35:52,800 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=40 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1080, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 11:35:52,800 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #17, conn_id=0) 11:35:52,800 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeC-21874#17 11:35:52,800 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1080 11:35:52,800 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeA-p406-t5) Removed remote transaction GlobalTx:NodeD-43076:25 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}=ReadCommittedEntry(15cc7a7c){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} 11:35:52,800 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeA-p406-t5) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, flags=[], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true}], lookedUpEntries={MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}=ReadCommittedEntry(15cc7a7c){key=MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}, value=v4, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}], lookedUpEntriesTopology=7, isMarkedForRollback=false, tx=GlobalTx:NodeD-43076:25, state=null} from transaction table. 11:35:52,800 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-threadNodeA-p406-t5) Transaction GlobalTx:NodeD-43076:25 has completed, notifying listening threads. 11:35:52,800 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-threadNodeA-p406-t5) Marking transaction GlobalTx:NodeD-43076:25 as completed 11:35:52,800 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-threadNodeA-p406-t5) Invoking forward of TxCompletionNotification for transaction GlobalTx:NodeD-43076:25. Affected keys: [MagicKey#k4{1B/5E8E8BA4/60@NodeD-43076}] 11:35:52,800 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-threadNodeA-p406-t5) CommandTopologyId=7, localTopologyId=7 11:35:52,800 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-threadNodeA-p406-t5) Release locks for keys=[]. owner=GlobalTx:NodeD-43076:25 11:35:52,804 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} [sender=NodeC-21874] 11:35:52,804 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,804 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Removed node NodeC-21874 from cache dist: members = [NodeA-45995, NodeB-51742, NodeD-43076], joiners = [] 11:35:52,805 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Cache dist topology updated: CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]}, members = [NodeA-45995, NodeB-51742, NodeD-43076], joiners = [] 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, ts=12, TP: [cluster_name=ISPN] 11:35:52,798 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (63 bytes) 11:35:52,805 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeD-43076) NodeD-43076 <-- ACK(NodeA-45995: #15, conn-id=0, ts=12) 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=20, ts=14, TP: [cluster_name=ISPN] 11:35:52,805 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeB-51742) NodeB-51742 <-- ACK(NodeA-45995: #20, conn-id=0, ts=14) 11:35:52,805 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t5) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,805 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t5) Updating cluster-wide current topology for cache dist, topology = CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]}, availability mode = AVAILABLE 11:35:52,805 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t5) dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:52,805 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:52,805 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t5) NodeA-45995: sending NodeA-45995#12 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 11:35:52,805 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t5) NodeA-45995 used 3566 credits, 1962786 remaining 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (3617 bytes (18085.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (3620 bytes) 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (3620 bytes) 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (3620 bytes) 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=3566 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 11:35:52,805 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#12 11:35:52,805 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#12 11:35:52,805 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=3566 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 11:35:52,805 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#12 11:35:52,805 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#12 11:35:52,805 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,805 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,805 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,806 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,806 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,806 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 3566 credits, 1962786 remaining 11:35:52,806 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-threadNodeC-p458-t6) Ignoring consistent hash update 8 for cache dist that doesn't exist locally 11:35:52,806 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t1) Waiting on view 3 being accepted 11:35:52,806 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t1) Updating local topology for cache dist: CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,806 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t1) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,806 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 3566 credits, 1962786 remaining 11:35:52,805 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=3566 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 11:35:52,806 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: received NodeA-45995#12 11:35:52,805 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Queueing rebalance for cache dist with members [NodeA-45995, NodeB-51742, NodeD-43076] 11:35:52,805 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} 11:35:52,807 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t5) Waiting on view 3 being accepted 11:35:52,807 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t5) Updating local topology for cache dist: CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,807 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Rebalancing consistent hash for cache dist, members are [NodeA-45995, NodeB-51742, NodeD-43076] 11:35:52,807 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t5) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,807 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t5) Installing new cache topology CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,807 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=8, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,807 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t5) Signalling topology 8 is installed 11:35:52,807 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 93, 94, 95, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 128, 129, 130, 131, 132, 133, 134, 142, 143, 144, 146, 147, 148, 149, 150, 151, 152, 153, 158, 159, 160, 161, 162, 163, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 182, 183, 184, 185, 186, 187, 190, 191, 192, 193, 194, 195, 196, 197, 201, 202, 203, 204, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 93, 94, 95, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 128, 129, 130, 131, 132, 133, 134, 142, 143, 144, 146, 147, 148, 149, 150, 151, 152, 153, 158, 159, 160, 161, 162, 163, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 182, 183, 184, 185, 186, 187, 190, 191, 192, 193, 194, 195, 196, 197, 201, 202, 203, 204, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 251, 252, 253, 254, 255] 11:35:52,807 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) On cache dist we have: added segments: []; removed segments: [] 11:35:52,807 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 11:35:52,807 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t5) Signalling transaction data received for topology 8 11:35:52,807 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,807 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,807 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Removing no longer owned entries for cache dist 11:35:52,807 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) Topology changed, recalculating minTopologyId 11:35:52,807 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) Changing minimum topology ID from 7 to 8 11:35:52,807 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Updating cache dist topology for rebalance: CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,807 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t5) Cache dist topology updated: CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]}, members = [NodeA-45995, NodeB-51742, NodeD-43076], joiners = [] 11:35:52,807 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t5) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,807 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t5) Pending consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0 1, 7: 0 2 1, 8: 2 0 1, 9: 2 0 1, 10: 0 2 1, 11: 2 0 1, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 2 1 0, 16: 2 1 0, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0 1, 31: 0 2 1, 32: 2 0 1, 33: 2 0 1, 34: 0 2 1, 35: 2 1 0, 36: 1 2 0, 37: 1 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0 1, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 0 2 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 2 1 0, 52: 2 1 0, 53: 2 1 0, 54: 2 1 0, 55: 1 0 2, 56: 0 1 2, 57: 0 1 2, 58: 1 0 2, 59: 0 2 1, 60: 2 0 1, 61: 0 1 2, 62: 0 1 2, 63: 1 0 2, 64: 0 1 2, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2 0, 83: 2 0 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 1 2, 90: 0 1 2, 91: 1 2 0, 92: 1 2 0, 93: 2 0 1, 94: 0 1 2, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 2 1 0, 101: 1 0 2, 102: 1 0 2, 103: 1 0 2, 104: 0 2 1, 105: 2 0 1, 106: 2 0 1, 107: 2 0 1, 108: 0 2 1, 109: 0 2 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0 1, 116: 2 0 1, 117: 0 1 2, 118: 0 1 2, 119: 1 0 2, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 0 2, 128: 0 2 1, 129: 2 0 1, 130: 0 1 2, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 1 2, 135: 1 2 0, 136: 2 1 0, 137: 1 2 0, 138: 2 1 0, 139: 2 1 0, 140: 2 1 0, 141: 1 2 0, 142: 2 1 0, 143: 1 0 2, 144: 0 2 1, 145: 2 1 0, 146: 2 1 0, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 1 0, 151: 1 0 2, 152: 0 2 1, 153: 0 2 1, 154: 0 2 1, 155: 2 1 0, 156: 1 2 0, 157: 2 1 0, 158: 1 0 2, 159: 1 0 2, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 0 1, 165: 0 1 2, 166: 1 0 2, 167: 0 1 2, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 2 1 0, 174: 1 0 2, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 1 0, 180: 2 1 0, 181: 1 2 0, 182: 1 2 0, 183: 2 1 0, 184: 2 1 0, 185: 1 2 0, 186: 2 0 1, 187: 0 2 1, 188: 2 1 0, 189: 1 2 0, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 2 0 1, 207: 0 2 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 0 2 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 1 0 2, 231: 0 1 2, 232: 1 2 0, 233: 2 1 0, 234: 1 2 0, 235: 1 2 0, 236: 2 1 0, 237: 1 0 2, 238: 1 0 2, 239: 0 1 2, 240: 1 2 0, 241: 2 0 1, 242: 0 1 2, 243: 0 1 2, 244: 1 0 2, 245: 0 2 1, 246: 0 2 1, 247: 2 0 1, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 0 1, 255: 2 0 1 11:35:52,807 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Initialized rebalance confirmation collector 9@dist, initial list is [NodeD-43076, NodeA-45995, NodeB-51742] 11:35:52,807 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000310: Starting cluster-wide rebalance for cache dist, topology CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,808 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) [Context=dist][Scope=NodeA-45995]ISPN100002: Started local rebalance 11:35:52,808 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} 11:35:52,808 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t5) dests=null, command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:52,808 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:52,808 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t5) NodeA-45995: sending NodeA-45995#13 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 11:35:52,808 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t5) NodeA-45995 used 7752 credits, 1955034 remaining 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (7803 bytes (39015.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (7806 bytes) 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (7806 bytes) 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (7806 bytes) 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=7752 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 11:35:52,808 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#13 11:35:52,808 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#13 11:35:52,806 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#12 11:35:52,808 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=7752 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 11:35:52,808 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: received NodeA-45995#13 11:35:52,808 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,808 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,808 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 7752 credits, 1955034 remaining 11:35:52,806 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t1) Installing new cache topology CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,808 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=8, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,808 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t1) Signalling topology 8 is installed 11:35:52,808 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 32, 33, 34, 35, 36, 38, 39, 40, 41, 51, 52, 53, 54, 55, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 77, 78, 79, 80, 81, 82, 84, 85, 86, 87, 89, 90, 91, 92, 94, 95, 96, 97, 98, 99, 100, 101, 102, 110, 111, 112, 113, 114, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 130, 131, 132, 135, 136, 137, 138, 139, 140, 141, 145, 146, 147, 151, 152, 153, 154, 155, 156, 157, 158, 164, 165, 166, 167, 168, 169, 170, 171, 174, 175, 176, 177, 178, 179, 180, 181, 187, 188, 189, 190, 191, 192, 193, 197, 198, 199, 200, 201, 202, 203, 204, 205, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250, 251, 252, 255]; old segments: [0, 1, 2, 3, 4, 5, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 32, 33, 34, 35, 36, 38, 39, 40, 41, 51, 52, 53, 54, 55, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 77, 78, 79, 80, 81, 82, 84, 85, 86, 87, 89, 90, 91, 92, 94, 95, 96, 97, 98, 99, 100, 101, 102, 110, 111, 112, 113, 114, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 130, 131, 132, 135, 136, 137, 138, 139, 140, 141, 145, 146, 147, 151, 152, 153, 154, 155, 156, 157, 158, 164, 165, 166, 167, 168, 169, 170, 171, 174, 175, 176, 177, 178, 179, 180, 181, 187, 188, 189, 190, 191, 192, 193, 197, 198, 199, 200, 201, 202, 203, 204, 205, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250, 251, 252, 255] 11:35:52,808 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) On cache dist we have: added segments: []; removed segments: [] 11:35:52,808 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 11:35:52,809 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t1) Signalling transaction data received for topology 8 11:35:52,809 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,809 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,809 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Removing no longer owned entries for cache dist 11:35:52,809 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) Topology changed, recalculating minTopologyId 11:35:52,809 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) Changing minimum topology ID from 7 to 8 11:35:52,810 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#13 11:35:52,808 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=7752 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 11:35:52,808 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,810 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#13 11:35:52,810 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#13 11:35:52,810 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,810 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,810 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,810 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,810 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeD-43076) NodeA-45995 used 3566 credits, 1978993 remaining 11:35:52,810 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,810 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 7752 credits, 1955034 remaining 11:35:52,810 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-threadNodeC-p458-t6) Ignoring rebalance 9 for cache dist that doesn't exist locally 11:35:52,808 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Rebalance confirmation collector 9@dist members list updated, remaining list is [NodeD-43076, NodeA-45995, NodeB-51742] 11:35:52,811 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=null} for command CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeC-21874, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} 11:35:52,810 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t5) Waiting on view 3 being accepted 11:35:52,810 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,809 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t1) Waiting on view 3 being accepted 11:35:52,811 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t1) Updating local topology for cache dist: CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,812 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t1) Starting local rebalance for cache dist, topology = CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,812 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t1) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,812 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t1) Pending consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0 1, 7: 0 2 1, 8: 2 0 1, 9: 2 0 1, 10: 0 2 1, 11: 2 0 1, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 2 1 0, 16: 2 1 0, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0 1, 31: 0 2 1, 32: 2 0 1, 33: 2 0 1, 34: 0 2 1, 35: 2 1 0, 36: 1 2 0, 37: 1 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0 1, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 0 2 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 2 1 0, 52: 2 1 0, 53: 2 1 0, 54: 2 1 0, 55: 1 0 2, 56: 0 1 2, 57: 0 1 2, 58: 1 0 2, 59: 0 2 1, 60: 2 0 1, 61: 0 1 2, 62: 0 1 2, 63: 1 0 2, 64: 0 1 2, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2 0, 83: 2 0 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 1 2, 90: 0 1 2, 91: 1 2 0, 92: 1 2 0, 93: 2 0 1, 94: 0 1 2, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 2 1 0, 101: 1 0 2, 102: 1 0 2, 103: 1 0 2, 104: 0 2 1, 105: 2 0 1, 106: 2 0 1, 107: 2 0 1, 108: 0 2 1, 109: 0 2 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0 1, 116: 2 0 1, 117: 0 1 2, 118: 0 1 2, 119: 1 0 2, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 0 2, 128: 0 2 1, 129: 2 0 1, 130: 0 1 2, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 1 2, 135: 1 2 0, 136: 2 1 0, 137: 1 2 0, 138: 2 1 0, 139: 2 1 0, 140: 2 1 0, 141: 1 2 0, 142: 2 1 0, 143: 1 0 2, 144: 0 2 1, 145: 2 1 0, 146: 2 1 0, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 1 0, 151: 1 0 2, 152: 0 2 1, 153: 0 2 1, 154: 0 2 1, 155: 2 1 0, 156: 1 2 0, 157: 2 1 0, 158: 1 0 2, 159: 1 0 2, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 0 1, 165: 0 1 2, 166: 1 0 2, 167: 0 1 2, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 2 1 0, 174: 1 0 2, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 1 0, 180: 2 1 0, 181: 1 2 0, 182: 1 2 0, 183: 2 1 0, 184: 2 1 0, 185: 1 2 0, 186: 2 0 1, 187: 0 2 1, 188: 2 1 0, 189: 1 2 0, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 2 0 1, 207: 0 2 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 0 2 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 1 0 2, 231: 0 1 2, 232: 1 2 0, 233: 2 1 0, 234: 1 2 0, 235: 1 2 0, 236: 2 1 0, 237: 1 0 2, 238: 1 0 2, 239: 0 1 2, 240: 1 2 0, 241: 2 0 1, 242: 0 1 2, 243: 0 1 2, 244: 1 0 2, 245: 0 2 1, 246: 0 2 1, 247: 2 0 1, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 0 1, 255: 2 0 1 11:35:52,812 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t1) Installing new cache topology CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+163, NodeB-51742: 74+182, NodeD-43076: 89+167]}, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,812 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=9, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+163, NodeB-51742: 74+182, NodeD-43076: 89+167]}, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,812 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Start keeping track of keys for rebalance 11:35:52,812 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,812 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t1) Tracking is disabled. Clear tracker: {} 11:35:52,812 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t1) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:52,812 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t1) Signalling topology 9 is installed 11:35:52,812 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 32, 33, 34, 35, 36, 38, 39, 40, 41, 51, 52, 53, 54, 55, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 77, 78, 79, 80, 81, 82, 84, 85, 86, 87, 89, 90, 91, 92, 94, 95, 96, 97, 98, 99, 100, 101, 102, 110, 111, 112, 113, 114, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 130, 131, 132, 135, 136, 137, 138, 139, 140, 141, 145, 146, 147, 151, 152, 153, 154, 155, 156, 157, 158, 164, 165, 166, 167, 168, 169, 170, 171, 174, 175, 176, 177, 178, 179, 180, 181, 187, 188, 189, 190, 191, 192, 193, 197, 198, 199, 200, 201, 202, 203, 204, 205, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250, 251, 252, 255] 11:35:52,812 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) On cache dist we have: added segments: [6, 7, 8, 9, 10, 11, 30, 31, 37, 42, 43, 44, 45, 46, 47, 48, 49, 50, 56, 57, 58, 59, 60, 76, 83, 88, 93, 103, 104, 105, 106, 107, 108, 109, 115, 116, 128, 129, 133, 134, 142, 143, 144, 148, 149, 150, 159, 160, 161, 162, 163, 172, 173, 182, 183, 184, 185, 186, 194, 195, 196, 206, 219, 220, 221, 222, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 253, 254]; removed segments: [] 11:35:52,812 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Adding inbound state transfer for segments [6, 7, 8, 9, 10, 11, 30, 31, 37, 42, 43, 44, 45, 46, 47, 48, 49, 50, 56, 57, 58, 59, 60, 76, 83, 88, 93, 103, 104, 105, 106, 107, 108, 109, 115, 116, 128, 129, 133, 134, 142, 143, 144, 148, 149, 150, 159, 160, 161, 162, 163, 172, 173, 182, 183, 184, 185, 186, 194, 195, 196, 206, 219, 220, 221, 222, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 253, 254] of cache dist 11:35:52,811 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1080 to NodeC-21874 11:35:52,813 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeC-21874: #12, conn_id=2) 11:35:52,813 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1080, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,811 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t2) Waiting on view 3 being accepted 11:35:52,813 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeD-p532-t5) Updating local topology for cache dist: CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,813 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,814 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,814 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeD-43076) NodeA-45995 used 7752 credits, 1971241 remaining 11:35:52,814 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeD-p532-t5) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,814 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeD-p532-t5) Installing new cache topology CacheTopology{id=8, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,814 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=8, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,814 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t5) Signalling topology 8 is installed 11:35:52,814 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255] 11:35:52,814 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) On cache dist we have: added segments: []; removed segments: [] 11:35:52,814 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 11:35:52,814 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t5) Signalling transaction data received for topology 8 11:35:52,814 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,814 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,812 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Requesting transactions for segments [128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254] of cache dist from node NodeD-43076 11:35:52,814 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeB-p417-t1) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,814 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t1) dests=[NodeD-43076], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]}, mode=SYNCHRONOUS, timeout=240000 11:35:52,814 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} to single recipient NodeD-43076 with response mode GET_ALL 11:35:52,814 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeB-p417-t1) NodeB-51742: invoking unicast RPC [req-id=1088] on NodeD-43076 11:35:52,814 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t1) NodeB-51742 --> DATA(NodeD-43076: #7, conn_id=2) 11:35:52,814 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t1) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1088, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,814 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (321 bytes (1605.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,815 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (324 bytes) 11:35:52,814 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Removing no longer owned entries for cache dist 11:35:52,816 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) Topology changed, recalculating minTopologyId 11:35:52,816 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) Changing minimum topology ID from 7 to 8 11:35:52,816 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t5) Waiting on view 3 being accepted 11:35:52,813 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:52,816 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (80 bytes) 11:35:52,813 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t2) Updating local topology for cache dist: CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,816 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t2) Starting local rebalance for cache dist, topology = CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,816 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t2) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,816 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t2) Pending consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0 1, 7: 0 2 1, 8: 2 0 1, 9: 2 0 1, 10: 0 2 1, 11: 2 0 1, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 2 1 0, 16: 2 1 0, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0 1, 31: 0 2 1, 32: 2 0 1, 33: 2 0 1, 34: 0 2 1, 35: 2 1 0, 36: 1 2 0, 37: 1 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0 1, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 0 2 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 2 1 0, 52: 2 1 0, 53: 2 1 0, 54: 2 1 0, 55: 1 0 2, 56: 0 1 2, 57: 0 1 2, 58: 1 0 2, 59: 0 2 1, 60: 2 0 1, 61: 0 1 2, 62: 0 1 2, 63: 1 0 2, 64: 0 1 2, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2 0, 83: 2 0 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 1 2, 90: 0 1 2, 91: 1 2 0, 92: 1 2 0, 93: 2 0 1, 94: 0 1 2, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 2 1 0, 101: 1 0 2, 102: 1 0 2, 103: 1 0 2, 104: 0 2 1, 105: 2 0 1, 106: 2 0 1, 107: 2 0 1, 108: 0 2 1, 109: 0 2 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0 1, 116: 2 0 1, 117: 0 1 2, 118: 0 1 2, 119: 1 0 2, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 0 2, 128: 0 2 1, 129: 2 0 1, 130: 0 1 2, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 1 2, 135: 1 2 0, 136: 2 1 0, 137: 1 2 0, 138: 2 1 0, 139: 2 1 0, 140: 2 1 0, 141: 1 2 0, 142: 2 1 0, 143: 1 0 2, 144: 0 2 1, 145: 2 1 0, 146: 2 1 0, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 1 0, 151: 1 0 2, 152: 0 2 1, 153: 0 2 1, 154: 0 2 1, 155: 2 1 0, 156: 1 2 0, 157: 2 1 0, 158: 1 0 2, 159: 1 0 2, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 0 1, 165: 0 1 2, 166: 1 0 2, 167: 0 1 2, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 2 1 0, 174: 1 0 2, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 1 0, 180: 2 1 0, 181: 1 2 0, 182: 1 2 0, 183: 2 1 0, 184: 2 1 0, 185: 1 2 0, 186: 2 0 1, 187: 0 2 1, 188: 2 1 0, 189: 1 2 0, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 2 0 1, 207: 0 2 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 0 2 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 1 0 2, 231: 0 1 2, 232: 1 2 0, 233: 2 1 0, 234: 1 2 0, 235: 1 2 0, 236: 2 1 0, 237: 1 0 2, 238: 1 0 2, 239: 0 1 2, 240: 1 2 0, 241: 2 0 1, 242: 0 1 2, 243: 0 1 2, 244: 1 0 2, 245: 0 2 1, 246: 0 2 1, 247: 2 0 1, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 0 1, 255: 2 0 1 11:35:52,816 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t2) Installing new cache topology CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+163, NodeB-51742: 74+182, NodeD-43076: 89+167]}, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,816 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=9, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+163, NodeB-51742: 74+182, NodeD-43076: 89+167]}, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,816 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Start keeping track of keys for rebalance 11:35:52,816 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t2) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,816 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t2) Tracking is disabled. Clear tracker: {} 11:35:52,816 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t2) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:52,816 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t2) Signalling topology 9 is installed 11:35:52,817 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 93, 94, 95, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 128, 129, 130, 131, 132, 133, 134, 142, 143, 144, 146, 147, 148, 149, 150, 151, 152, 153, 158, 159, 160, 161, 162, 163, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 182, 183, 184, 185, 186, 187, 190, 191, 192, 193, 194, 195, 196, 197, 201, 202, 203, 204, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 251, 252, 253, 254, 255] 11:35:52,817 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) On cache dist we have: added segments: [14, 15, 16, 32, 33, 34, 35, 36, 51, 52, 53, 75, 82, 91, 92, 96, 97, 98, 99, 100, 101, 102, 127, 135, 136, 137, 138, 139, 140, 141, 145, 154, 155, 156, 157, 164, 176, 177, 178, 179, 180, 181, 188, 189, 198, 199, 200, 205, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250]; removed segments: [] 11:35:52,817 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Adding inbound state transfer for segments [14, 15, 16, 32, 33, 34, 35, 36, 51, 52, 53, 75, 82, 91, 92, 96, 97, 98, 99, 100, 101, 102, 127, 135, 136, 137, 138, 139, 140, 141, 145, 154, 155, 156, 157, 164, 176, 177, 178, 179, 180, 181, 188, 189, 198, 199, 200, 205, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250] of cache dist 11:35:52,817 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Requesting transactions for segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist from node NodeD-43076 11:35:52,817 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t2) NodeA-45995 invoking StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,817 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t2) dests=[NodeD-43076], command=StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]}, mode=SYNCHRONOUS, timeout=240000 11:35:52,817 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t2) Replication task sending StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to single recipient NodeD-43076 with response mode GET_ALL 11:35:52,817 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t2) NodeA-45995: invoking unicast RPC [req-id=1092] on NodeD-43076 11:35:52,817 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t2) NodeA-45995 --> DATA(NodeD-43076: #14, conn_id=3) 11:35:52,817 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t2) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1092, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,816 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1080, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,817 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874 <-- DATA(NodeA-45995: #12, conn_id=2) 11:35:52,817 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#12 11:35:52,817 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeC-21874) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 11:35:52,816 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=248 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1088, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,817 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeD-p532-t5) Updating local topology for cache dist: CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,817 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeD-p532-t5) Starting local rebalance for cache dist, topology = CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,817 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeD-p532-t5) Current consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0, 7: 0 2, 8: 2 0, 9: 0 2, 10: 0 2, 11: 2 0, 12: 0 1, 13: 0 1 2, 14: 1 2, 15: 2 1, 16: 2 1, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0, 31: 0 2, 32: 2 1, 33: 2 1, 34: 2 1, 35: 2 1, 36: 1 2, 37: 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0, 43: 0 2, 44: 2 0, 45: 2 0, 46: 0 2, 47: 0 2, 48: 0 2, 49: 2 0, 50: 0 2, 51: 2 1, 52: 2 1, 53: 2 1, 54: 1 0, 55: 1 0, 56: 0 2, 57: 0 2, 58: 0 2, 59: 0 2, 60: 2 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 2, 76: 2 0, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2, 83: 2 0, 84: 0 1, 85: 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0, 89: 0 1, 90: 0 1, 91: 1 2, 92: 1 2, 93: 2 0, 94: 0 1, 95: 0 1 2, 96: 1 2, 97: 1 2, 98: 1 2, 99: 2 1, 100: 2 1, 101: 1 2, 102: 1 2, 103: 2 0, 104: 2 0, 105: 2 0, 106: 2 0, 107: 0 2, 108: 0 2, 109: 0 2, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0, 116: 2 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0, 126: 0 1, 127: 1 2, 128: 2 0, 129: 2 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 2, 134: 0 2, 135: 2 1, 136: 2 1, 137: 2 1, 138: 2 1, 139: 2 1, 140: 2 1, 141: 1 2, 142: 2 0, 143: 0 2, 144: 0 2, 145: 2 1, 146: 2 1 0, 147: 1 2 0, 148: 2 0, 149: 0 2, 150: 2 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 2, 155: 1 2, 156: 1 2, 157: 2 1, 158: 1 0, 159: 0 2, 160: 0 2, 161: 0 2, 162: 2 0, 163: 0 2, 164: 2 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2, 173: 2 0, 174: 0 1, 175: 0 1, 176: 1 2, 177: 1 2, 178: 1 2, 179: 2 1, 180: 2 1, 181: 1 2, 182: 2 0, 183: 2 0, 184: 2 0, 185: 2 0, 186: 2 0, 187: 0 1, 188: 1 2, 189: 1 2, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2, 195: 2 0, 196: 0 2, 197: 0 2 1, 198: 2 1, 199: 1 2, 200: 2 1, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2, 206: 2 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 2, 220: 0 2, 221: 0 2, 222: 2 0, 223: 2 0 1, 224: 0 1 2, 225: 1 2, 226: 2 1, 227: 1 2, 228: 1 2, 229: 2 1, 230: 1 2, 231: 1 2, 232: 1 2, 233: 2 1, 234: 1 2, 235: 1 2, 236: 2 1, 237: 1 2, 238: 2 0, 239: 2 0, 240: 2 0, 241: 2 0, 242: 0 2, 243: 0 2, 244: 0 2, 245: 0 2, 246: 2 0, 247: 2 0, 248: 0 2, 249: 2 1, 250: 2 1, 251: 2 1 0, 252: 1 0, 253: 0 2, 254: 2 0, 255: 2 0 1 11:35:52,817 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Shutting down StateConsumer of cache dist on node NodeC-21874 11:35:52,817 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (261 bytes (1305.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,819 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (264 bytes) 11:35:52,819 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=188 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1092, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,819 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #14, conn_id=3) 11:35:52,819 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#14 11:35:52,819 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1092 11:35:52,819 TRACE [org.infinispan.statetransfer.StateProviderImpl] (testng) Shutting down StateProvider of cache dist on node NodeC-21874 11:35:52,819 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} [sender=NodeA-45995] 11:35:52,819 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #7, conn_id=2) 11:35:52,819 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task to the queue: 1 task(s) are waiting 11:35:52,819 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeB-51742#7 11:35:52,819 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1088 11:35:52,819 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-threadNodeD) Tasks to be executed=0, still pending=~1 11:35:52,819 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} [sender=NodeB-51742] 11:35:52,819 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task to the queue: 2 task(s) are waiting 11:35:52,819 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-threadNodeD) Tasks to be executed=0, still pending=~2 11:35:52,822 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeD-p532-t5) Pending consistent hash's routing table: 0: 0 2 1, 1: 2 0 1, 2: 0 2 1, 3: 2 1 0, 4: 1 2 0, 5: 1 2 0, 6: 2 0 1, 7: 0 2 1, 8: 2 0 1, 9: 2 0 1, 10: 0 2 1, 11: 2 0 1, 12: 2 0 1, 13: 0 1 2, 14: 1 2 0, 15: 2 1 0, 16: 2 1 0, 17: 2 1 0, 18: 2 1 0, 19: 2 1 0, 20: 1 0 2, 21: 1 0 2, 22: 1 0 2, 23: 0 1 2, 24: 0 1 2, 25: 0 1 2, 26: 1 0 2, 27: 0 1 2, 28: 1 2 0, 29: 1 2 0, 30: 2 0 1, 31: 0 2 1, 32: 2 0 1, 33: 2 0 1, 34: 0 2 1, 35: 2 1 0, 36: 1 2 0, 37: 1 2 0, 38: 2 0 1, 39: 0 2 1, 40: 2 1 0, 41: 1 2 0, 42: 2 0 1, 43: 0 2 1, 44: 2 0 1, 45: 0 2 1, 46: 0 2 1, 47: 0 2 1, 48: 0 2 1, 49: 2 0 1, 50: 0 2 1, 51: 2 1 0, 52: 2 1 0, 53: 2 1 0, 54: 2 1 0, 55: 1 0 2, 56: 0 1 2, 57: 0 1 2, 58: 1 0 2, 59: 0 2 1, 60: 2 0 1, 61: 0 1 2, 62: 0 1 2, 63: 1 0 2, 64: 0 1 2, 65: 0 1 2, 66: 1 0 2, 67: 0 1 2, 68: 0 1 2, 69: 0 1 2, 70: 0 1 2, 71: 1 2 0, 72: 1 2 0, 73: 2 0 1, 74: 0 1 2, 75: 1 2 0, 76: 2 0 1, 77: 2 0 1, 78: 0 1 2, 79: 0 1 2, 80: 1 0 2, 81: 0 1 2, 82: 1 2 0, 83: 2 0 1, 84: 2 0 1, 85: 2 0 1, 86: 0 1 2, 87: 1 2 0, 88: 2 0 1, 89: 0 1 2, 90: 0 1 2, 91: 1 2 0, 92: 1 2 0, 93: 2 0 1, 94: 0 1 2, 95: 0 1 2, 96: 1 2 0, 97: 1 2 0, 98: 1 2 0, 99: 2 1 0, 100: 2 1 0, 101: 1 0 2, 102: 1 0 2, 103: 1 0 2, 104: 0 2 1, 105: 2 0 1, 106: 2 0 1, 107: 2 0 1, 108: 0 2 1, 109: 0 2 1, 110: 0 2 1, 111: 2 0 1, 112: 0 1 2, 113: 1 2 0, 114: 1 2 0, 115: 2 0 1, 116: 2 0 1, 117: 0 1 2, 118: 0 1 2, 119: 1 0 2, 120: 0 1 2, 121: 1 0 2, 122: 1 0 2, 123: 0 2 1, 124: 2 1 0, 125: 1 0 2, 126: 0 1 2, 127: 1 0 2, 128: 0 2 1, 129: 2 0 1, 130: 0 1 2, 131: 0 1 2, 132: 1 2 0, 133: 2 0 1, 134: 0 1 2, 135: 1 2 0, 136: 2 1 0, 137: 1 2 0, 138: 2 1 0, 139: 2 1 0, 140: 2 1 0, 141: 1 2 0, 142: 2 1 0, 143: 1 0 2, 144: 0 2 1, 145: 2 1 0, 146: 2 1 0, 147: 1 2 0, 148: 2 0 1, 149: 0 2 1, 150: 2 1 0, 151: 1 0 2, 152: 0 2 1, 153: 0 2 1, 154: 0 2 1, 155: 2 1 0, 156: 1 2 0, 157: 2 1 0, 158: 1 0 2, 159: 1 0 2, 160: 0 2 1, 161: 0 2 1, 162: 2 0 1, 163: 0 2 1, 164: 2 0 1, 165: 0 1 2, 166: 1 0 2, 167: 0 1 2, 168: 1 2 0, 169: 2 1 0, 170: 1 0 2, 171: 1 0 2, 172: 0 2 1, 173: 2 1 0, 174: 1 0 2, 175: 0 1 2, 176: 1 2 0, 177: 1 2 0, 178: 1 2 0, 179: 2 1 0, 180: 2 1 0, 181: 1 2 0, 182: 1 2 0, 183: 2 1 0, 184: 2 1 0, 185: 1 2 0, 186: 2 0 1, 187: 0 2 1, 188: 2 1 0, 189: 1 2 0, 190: 1 2 0, 191: 2 1 0, 192: 2 1 0, 193: 1 0 2, 194: 0 2 1, 195: 2 0 1, 196: 2 0 1, 197: 0 2 1, 198: 2 1 0, 199: 1 2 0, 200: 2 1 0, 201: 2 1 0, 202: 1 0 2, 203: 1 0 2, 204: 0 1 2, 205: 1 2 0, 206: 2 0 1, 207: 0 2 1, 208: 2 0 1, 209: 0 1 2, 210: 0 1 2, 211: 1 2 0, 212: 1 2 0, 213: 2 0 1, 214: 0 2 1, 215: 2 0 1, 216: 0 1 2, 217: 1 0 2, 218: 1 0 2, 219: 0 2 1, 220: 0 2 1, 221: 0 2 1, 222: 0 2 1, 223: 2 0 1, 224: 0 1 2, 225: 1 2 0, 226: 2 1 0, 227: 2 1 0, 228: 1 2 0, 229: 2 1 0, 230: 1 0 2, 231: 0 1 2, 232: 1 2 0, 233: 2 1 0, 234: 1 2 0, 235: 1 2 0, 236: 2 1 0, 237: 1 0 2, 238: 1 0 2, 239: 0 1 2, 240: 1 2 0, 241: 2 0 1, 242: 0 1 2, 243: 0 1 2, 244: 1 0 2, 245: 0 2 1, 246: 0 2 1, 247: 2 0 1, 248: 0 2 1, 249: 2 1 0, 250: 2 1 0, 251: 2 1 0, 252: 1 0 2, 253: 0 2 1, 254: 2 0 1, 255: 2 0 1 11:35:52,822 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeD-p532-t5) Installing new cache topology CacheTopology{id=9, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+163, NodeB-51742: 74+182, NodeD-43076: 89+167]}, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} on cache dist 11:35:52,822 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=9, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+100, NodeB-51742: 74+103, NodeD-43076: 89+112]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 93+163, NodeB-51742: 74+182, NodeD-43076: 89+167]}, actualMembers=[NodeA-45995, NodeB-51742, NodeD-43076], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294, 118b9279-4f00-4f56-aec1-b02991371145]} 11:35:52,822 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Start keeping track of keys for rebalance 11:35:52,822 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t5) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,822 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t5) Tracking is disabled. Clear tracker: {} 11:35:52,822 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeD-p532-t5) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:52,822 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t5) Signalling topology 9 is installed 11:35:52,822 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-threadNodeD) Tasks to be executed=2, still pending=~2 11:35:52,822 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t6) Calling perform() on StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,822 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeD-p530-t6) Received request for transactions from node NodeA-45995 for segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist with topology id 9 11:35:52,822 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 56, 57, 58, 59, 60, 75, 76, 77, 78, 79, 80, 81, 82, 83, 86, 87, 88, 91, 92, 93, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 127, 128, 129, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 154, 155, 156, 157, 159, 160, 161, 162, 163, 164, 170, 171, 172, 173, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 253, 254, 255] 11:35:52,822 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) On cache dist we have: added segments: [12, 54, 55, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 84, 85, 89, 90, 94, 117, 118, 119, 125, 126, 130, 131, 132, 151, 152, 153, 158, 165, 166, 167, 168, 169, 174, 175, 187, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 252]; removed segments: [] 11:35:52,823 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeD-p530-t6) Found 0 transaction(s) to transfer 11:35:52,823 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Adding inbound state transfer for segments [12, 54, 55, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 84, 85, 89, 90, 94, 117, 118, 119, 125, 126, 130, 131, 132, 151, 152, 153, 158, 165, 166, 167, 168, 169, 174, 175, 187, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 252] of cache dist 11:35:52,823 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t6) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,823 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Requesting transactions for segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist from node NodeA-45995 11:35:52,823 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t6) sending rsp for 1092 to NodeA-45995 11:35:52,823 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t6) NodeD-43076 --> DATA(NodeA-45995: #17, conn_id=0) 11:35:52,823 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeD-p532-t5) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,823 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t5) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]}, mode=SYNCHRONOUS, timeout=240000 11:35:52,823 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t6) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1092, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 11:35:52,823 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeD-p532-t5) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} to single recipient NodeA-45995 with response mode GET_ALL 11:35:52,823 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} 11:35:52,823 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeD-p530-t5) Received request for transactions from node NodeB-51742 for segments [128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254] of cache dist with topology id 9 11:35:52,823 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeD-p532-t5) NodeD-43076: invoking unicast RPC [req-id=1093] on NodeA-45995 11:35:52,823 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeD-p530-t5) Found 0 transaction(s) to transfer 11:35:52,823 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t5) NodeD-43076 --> DATA(NodeA-45995: #18, conn_id=0) 11:35:52,823 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} 11:35:52,823 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeD-p532-t5) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1093, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 11:35:52,823 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t5) sending rsp for 1088 to NodeB-51742 11:35:52,823 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t5) NodeD-43076 --> DATA(NodeB-51742: #6, conn_id=2) 11:35:52,823 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t5) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1088, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,823 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 3 msgs (453 bytes (2265.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeB-51742, ISPN:NodeA-45995] 11:35:52,823 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (84 bytes) 11:35:52,823 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (331 bytes) 11:35:52,825 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1088, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,825 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=218 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1093, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 11:35:52,825 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1092, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 11:35:52,825 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #18, conn_id=0) 11:35:52,825 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #17, conn_id=0) 11:35:52,825 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeD-43076#18 11:35:52,825 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#17 11:35:52,825 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1093 11:35:52,825 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: sender=NodeD-43076value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:52,825 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Response(s) to StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} is {NodeD-43076=SuccessfulResponse{responseValue=[]} } 11:35:52,825 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} [sender=NodeD-43076] 11:35:52,825 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,825 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} 11:35:52,825 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Applying 0 transactions for cache dist transferred from node NodeD-43076 11:35:52,825 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Received request for transactions from node NodeD-43076 for segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist with topology id 9 11:35:52,825 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #6, conn_id=2) 11:35:52,825 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeD-43076#6 11:35:52,825 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Found 0 transaction(s) to transfer 11:35:52,825 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-3,NodeB-51742) Responses: sender=NodeD-43076value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:52,825 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} 11:35:52,825 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-3,NodeB-51742) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} is {NodeD-43076=SuccessfulResponse{responseValue=[]} } 11:35:52,825 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Applying 0 transactions for cache dist transferred from node NodeD-43076 11:35:52,819 TRACE [org.infinispan.jmx.ComponentsJmxRegistration] (testng) Unregistering jmx resources.. 11:35:52,825 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictionSize [r=true,w=true,is=false,type=long] 11:35:52,825 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.util.List locateKey 11:35:52,828 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isLocatedLocally 11:35:52,825 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Requesting transactions for segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] of cache dist from node NodeA-45995 11:35:52,828 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeB-p417-t1) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,828 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t1) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]}, mode=SYNCHRONOUS, timeout=240000 11:35:52,828 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} to single recipient NodeA-45995 with response mode GET_ALL 11:35:52,825 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1093 to NodeD-43076 11:35:52,829 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Requesting transactions for segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] of cache dist from node NodeB-51742 11:35:52,829 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t2) NodeA-45995 invoking StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,829 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t2) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]}, mode=SYNCHRONOUS, timeout=240000 11:35:52,829 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t2) Replication task sending StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} to single recipient NodeB-51742 with response mode GET_ALL 11:35:52,829 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t2) NodeA-45995: invoking unicast RPC [req-id=1098] on NodeB-51742 11:35:52,829 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t2) NodeA-45995 --> DATA(NodeB-51742: #15, conn_id=1) 11:35:52,829 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #15, conn_id=3) 11:35:52,828 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeB-p417-t1) NodeB-51742: invoking unicast RPC [req-id=1096] on NodeA-45995 11:35:52,828 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isAffectedByRehash 11:35:52,832 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t1) NodeB-51742 --> DATA(NodeA-45995: #21, conn_id=0) 11:35:52,832 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t1) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1096, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 11:35:52,832 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (296 bytes (1480.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,832 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (299 bytes) 11:35:52,832 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=223 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1096, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 11:35:52,832 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #21, conn_id=0) 11:35:52,832 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#21 11:35:52,832 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,832 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 11:35:52,829 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t2) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1098, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,841 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1093, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,841 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 2 msgs (357 bytes (1785.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeD-43076, ISPN:NodeB-51742] 11:35:52,841 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (84 bytes) 11:35:52,841 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (279 bytes) 11:35:52,841 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=203 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1098, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,841 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1093, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,841 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #15, conn_id=1) 11:35:52,841 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #15, conn_id=3) 11:35:52,841 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#15 11:35:52,841 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:52,841 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:52,841 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Applying 0 transactions for cache dist transferred from node NodeA-45995 11:35:52,841 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationCount [r=true,w=false,is=false,type=long] 11:35:52,832 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1096 11:35:52,841 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationFailures [r=true,w=false,is=false,type=long] 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,841 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Requesting transactions for segments [66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63] of cache dist from node NodeB-51742 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStatisticsEnabled 11:35:52,841 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#15 11:35:52,842 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1098 11:35:52,842 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} [sender=NodeA-45995] 11:35:52,842 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,842 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:52,842 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Received request for transactions from node NodeA-45995 for segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] of cache dist with topology id 9 11:35:52,842 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Found 0 transaction(s) to transfer 11:35:52,842 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} 11:35:52,841 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} [sender=NodeB-51742] 11:35:52,842 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,842 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeD-p532-t5) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,842 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t5) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]}, mode=SYNCHRONOUS, timeout=240000 11:35:52,842 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeD-p532-t5) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} to single recipient NodeB-51742 with response mode GET_ALL 11:35:52,843 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeD-p532-t5) NodeD-43076: invoking unicast RPC [req-id=1099] on NodeB-51742 11:35:52,842 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1098 to NodeA-45995 11:35:52,842 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 11:35:52,843 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,843 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute commits [r=true,w=false,is=false,type=long] 11:35:52,843 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,844 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeA-45995: #22, conn_id=0) 11:35:52,844 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1098, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 11:35:52,844 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,844 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (84 bytes) 11:35:52,844 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1098, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 11:35:52,844 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #22, conn_id=0) 11:35:52,844 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#22 11:35:52,844 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeA-45995) Responses: sender=NodeB-51742value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:52,844 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeA-45995) Response(s) to StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} is {NodeB-51742=SuccessfulResponse{responseValue=[]} } 11:35:52,844 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Applying 0 transactions for cache dist transferred from node NodeB-51742 11:35:52,844 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Adding transfer from NodeD-43076 for segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] 11:35:52,844 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Adding transfer from NodeB-51742 for segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] 11:35:52,844 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Finished adding inbound state transfer for segments [14, 15, 16, 32, 33, 34, 35, 36, 51, 52, 53, 75, 82, 91, 92, 96, 97, 98, 99, 100, 101, 102, 127, 135, 136, 137, 138, 139, 140, 141, 145, 154, 155, 156, 157, 164, 176, 177, 178, 179, 180, 181, 188, 189, 198, 199, 200, 205, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 249, 250] of cache dist 11:35:52,844 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t1) Requesting segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist from node NodeD-43076 11:35:52,844 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Topology update processed, stateTransferTopologyId = 9, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]} 11:35:52,844 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t2) Signalling transaction data received for topology 9 11:35:52,844 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeA-p411-t1) NodeA-45995 invoking StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,844 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,845 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,845 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeA-p411-t1) dests=[NodeD-43076], command=StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,845 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeA-p411-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to addresses [NodeD-43076] with response mode GET_ALL 11:35:52,845 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Removing no longer owned entries for cache dist 11:35:52,845 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) Topology changed, recalculating minTopologyId 11:35:52,845 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) Changing minimum topology ID from 8 to 9 11:35:52,843 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t5) NodeD-43076 --> DATA(NodeB-51742: #7, conn_id=2) 11:35:52,845 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeD-p532-t5) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1099, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,845 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (206 bytes (1030.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,845 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (209 bytes) 11:35:52,845 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=133 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1099, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,845 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #7, conn_id=2) 11:35:52,845 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeD-43076#7 11:35:52,845 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1099 11:35:52,842 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} 11:35:52,845 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Received request for transactions from node NodeB-51742 for segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] of cache dist with topology id 9 11:35:52,845 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeA-p411-t1) NodeA-45995: invoking multicast RPC [req-id=1102] 11:35:52,845 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t5) Found 0 transaction(s) to transfer 11:35:52,846 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeA-p411-t1) NodeA-45995 --> DATA(NodeD-43076: #16, conn_id=3) 11:35:52,846 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} 11:35:52,846 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeA-p411-t1) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1102, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,846 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (261 bytes (1305.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,846 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (264 bytes) 11:35:52,846 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=188 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1102, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,846 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #16, conn_id=3) 11:35:52,846 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#16 11:35:52,846 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1102 11:35:52,846 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} [sender=NodeA-45995] 11:35:52,846 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeD-p530-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,843 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute prepares [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rollbacks [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void recordKnownGlobalKeyset 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void disconnectSource 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute invalidations [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute storeWrites [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStaleStatsTreshold 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:52,846 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute elapsedTime [r=true,w=false,is=false,type=long] 11:35:52,847 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Configuration 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RpcManager 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Activation 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Transactions 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=LockManager 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Passivation 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 11:35:52,847 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Statistics 11:35:52,847 DEBUG [org.infinispan.transaction.impl.TransactionTable] (testng) Wait for on-going transactions to finish for 0 milliseconds. 11:35:52,847 WARN [org.infinispan.transaction.impl.TransactionTable] (testng) ISPN000100: Stopping, but there are 0 local transactions and 1 remote transactions that did not finish in time. 11:35:52,846 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeD-p530-t5) Starting outbound transfer of segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] to node NodeA-45995 with topology id 9 for cache dist 11:35:52,848 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeD-p530-t5) Adding outbound transfer of segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] to NodeA-45995 11:35:52,848 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeD-p530-t5) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,848 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeD-p530-t5) sending rsp for 1102 to NodeA-45995 11:35:52,848 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeD-p532-t6) Sending last chunk containing 1 cache entries from segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist to node NodeA-45995 11:35:52,848 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Unfinished local transactions: [] 11:35:52,848 TRACE [org.infinispan.transaction.impl.TransactionTable] (testng) Unfinished remote transactions: [GlobalTx:NodeD-43076:25] 11:35:52,846 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,846 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1096 to NodeB-51742 11:35:52,849 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeB-51742: #16, conn_id=1) 11:35:52,849 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1096, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,849 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,849 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (84 bytes) 11:35:52,845 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} [sender=NodeD-43076] 11:35:52,850 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1096, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,850 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} 11:35:52,848 TRACE [org.infinispan.container.DefaultDataContainer] (testng) Clearing data container 11:35:52,848 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeD-p532-t6) NodeD-43076 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=33, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeD-43076, topologyId=9} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,848 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeD-p530-t5) NodeD-43076 --> DATA(NodeA-45995: #19, conn_id=0) 11:35:52,850 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeD-p530-t5) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1102, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 11:35:52,850 DEBUG [org.infinispan.xsite.BackupReceiverRepositoryImpl] (testng) Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'dist' 11:35:52,850 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,850 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeD-p532-t6) dests=[NodeA-45995], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=33, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeD-43076, topologyId=9}, mode=SYNCHRONOUS, timeout=240000 11:35:52,850 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Received request for transactions from node NodeD-43076 for segments [66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63] of cache dist with topology id 9 11:35:52,850 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,850 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #16, conn_id=1) 11:35:52,851 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Found 0 transaction(s) to transfer 11:35:52,851 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#16 11:35:52,851 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} 11:35:52,851 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:52,851 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (80 bytes) 11:35:52,851 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeD-p532-t6) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=33, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeD-43076, topologyId=9} to single recipient NodeA-45995 with response mode GET_ALL 11:35:52,851 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeD-p532-t6) NodeD-43076: invoking unicast RPC [req-id=1106] on NodeA-45995 11:35:52,851 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeD-p532-t6) NodeD-43076 --> DATA(NodeA-45995: #20, conn_id=0) 11:35:52,851 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeD-p532-t6) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1106, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 11:35:52,851 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (573 bytes (2865.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,851 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (576 bytes) 11:35:52,851 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1102, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 11:35:52,851 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #19, conn_id=0) 11:35:52,851 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeD-43076#19 11:35:52,850 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command SizeCommand{} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@b4e7fd0] 11:35:52,851 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: SizeCommand 11:35:52,851 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeA-45995) Responses: Responses{ NodeD-43076: sender=NodeD-43076value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,851 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=500 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1106, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 11:35:52,851 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #20, conn_id=0) 11:35:52,851 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#20 11:35:52,851 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1106 11:35:52,851 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeA-45995) Response(s) to StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} is {NodeD-43076=SuccessfulResponse{responseValue=null} } 11:35:52,852 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=33, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeD-43076, topologyId=9} [sender=NodeD-43076] 11:35:52,851 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeB-51742) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=GET_TRANSACTIONS, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} is {NodeA-45995=SuccessfulResponse{responseValue=[]} } 11:35:52,851 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1099 to NodeD-43076 11:35:52,852 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeD-43076: #8, conn_id=2) 11:35:52,852 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t1) Successfully requested segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist from node NodeD-43076 11:35:52,852 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1099, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,852 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,852 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (84 bytes) 11:35:52,852 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeA-45995) Checking if transaction data was received for topology 0, current topology is 9 11:35:52,855 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,851 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command KeySetCommand{cache=dist} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@199a1db0] 11:35:52,855 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: KeySetCommand 11:35:52,856 TRACE [org.infinispan.test.TestingUtil] (testng) Local size on NodeD-43076 before stopping: 4 11:35:52,856 DEBUG [org.infinispan.cache.impl.CacheImpl] (testng) Stopping cache dist on NodeD-43076 11:35:52,856 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t5) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=33, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeD-43076, topologyId=9} 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Before applying the received state the data container of cache dist has 3 keys 11:35:52,856 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (testng) Shutting down StateTransferManager of cache dist on node NodeD-43076 11:35:52,856 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Node NodeD-43076 leaving cache dist 11:35:52,856 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=SYNCHRONOUS, timeout=240000 11:35:52,856 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_ALL 11:35:52,856 TRACE [org.jgroups.blocks.RequestCorrelator] (testng) NodeD-43076: invoking unicast RPC [req-id=1108] on NodeA-45995 11:35:52,856 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #21, conn_id=0) 11:35:52,856 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1108, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 33 of cache dist from node NodeD-43076: received 1 cache entries 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Applying new state chunk for segment 136 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 135 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 135 of cache dist 11:35:52,856 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (113 bytes (565.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,856 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (116 bytes) 11:35:52,852 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], finishedSegments=[], unfinishedSegments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], source=NodeD-43076, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@691b60b6[Not completed], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,856 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Applying 0 transactions for cache dist transferred from node NodeA-45995 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Adding transfer from NodeD-43076 for segments [128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254] 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Adding transfer from NodeA-45995 for segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] 11:35:52,856 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) Requesting segments [128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254] of cache dist from node NodeD-43076 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Finished adding inbound state transfer for segments [6, 7, 8, 9, 10, 11, 30, 31, 37, 42, 43, 44, 45, 46, 47, 48, 49, 50, 56, 57, 58, 59, 60, 76, 83, 88, 93, 103, 104, 105, 106, 107, 108, 109, 115, 116, 128, 129, 133, 134, 142, 143, 144, 148, 149, 150, 159, 160, 161, 162, 163, 172, 173, 182, 183, 184, 185, 186, 194, 195, 196, 206, 219, 220, 221, 222, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 253, 254] of cache dist 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Topology update processed, stateTransferTopologyId = 9, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]} 11:35:52,857 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t1) Signalling transaction data received for topology 9 11:35:52,857 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,857 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,856 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,857 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeB-p427-t1) dests=[NodeD-43076], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,857 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeB-p427-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} to addresses [NodeD-43076] with response mode GET_ALL 11:35:52,857 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: invoking multicast RPC [req-id=1110] 11:35:52,857 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 --> DATA(NodeD-43076: #9, conn_id=2) 11:35:52,857 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1110, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,857 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (321 bytes (1605.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,857 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (324 bytes) 11:35:52,857 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=248 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1110, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,857 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #9, conn_id=2) 11:35:52,857 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeB-51742#9 11:35:52,857 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1110 11:35:52,857 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} [sender=NodeB-51742] 11:35:52,857 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Silently ignoring that dist cache is not defined 11:35:52,857 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (OOB-2,NodeD-43076) About to send back response CacheNotFoundResponse for command StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} 11:35:52,857 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) sending rsp for 1110 to NodeB-51742 11:35:52,857 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 --> DATA(NodeB-51742: #8, conn_id=2) 11:35:52,857 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1110, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,856 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeA-p411-t2) Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@1b 11:35:52,857 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) Invoked with command PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedMetadata{version=null}, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@223ad8e1] 11:35:52,857 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedMetadata{version=null}, successful=true}, origin null 11:35:52,858 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeA-p411-t2) Exists in context? null 11:35:52,858 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeA-p411-t2) Retrieved from container null 11:35:52,858 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeA-p411-t2) Creating new entry for key MagicKey#k3{1A/92BE3B55/33@NodeC-21874} 11:35:52,858 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeA-p411-t2) Updated context entry ReadCommittedEntry(2605587e){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,858 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) Invoking: PutKeyValueCommand 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Finished applying chunk of segment 136 of cache dist 11:35:52,858 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) The return value is null 11:35:52,858 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-threadNodeA-p411-t2) Release locks for keys=[]. owner=GlobalTx:NodeA-45995:27 11:35:52,858 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-threadNodeA-p411-t2) Clearing locked keys: [] 11:35:52,858 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=40 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1108, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 11:35:52,860 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,860 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #21, conn_id=0) 11:35:52,860 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#21 11:35:52,860 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (79 bytes) 11:35:52,860 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1108 11:35:52,860 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} [sender=NodeD-43076] 11:35:52,860 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,860 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Removed node NodeD-43076 from cache dist: members = [NodeA-45995, NodeB-51742], joiners = [] 11:35:52,856 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 198 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,860 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 198 of cache dist 11:35:52,861 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Cache dist topology updated: CacheTopology{id=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, members = [NodeA-45995, NodeB-51742], joiners = [] 11:35:52,856 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1099, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,861 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t6) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0 1, 13: 0 1, 14: 1, 15: 1, 16: 1, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0, 31: 0, 32: 1, 33: 1, 34: 1, 35: 1, 36: 1, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 1, 52: 1, 53: 1, 54: 1 0, 55: 1 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1, 76: 0, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1, 83: 0, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0, 89: 0 1, 90: 0 1, 91: 1, 92: 1, 93: 0, 94: 0 1, 95: 0 1, 96: 1, 97: 1, 98: 1, 99: 1, 100: 1, 101: 1, 102: 1, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0, 116: 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1, 128: 0, 129: 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0, 134: 0, 135: 1, 136: 1, 137: 1, 138: 1, 139: 1, 140: 1, 141: 1, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1 0, 147: 1 0, 148: 0, 149: 0, 150: 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1, 155: 1, 156: 1, 157: 1, 158: 1 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0, 173: 0, 174: 0 1, 175: 0 1, 176: 1, 177: 1, 178: 1, 179: 1, 180: 1, 181: 1, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0 1, 188: 1, 189: 1, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0, 195: 0, 196: 0, 197: 0 1, 198: 1, 199: 1, 200: 1, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1, 206: 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0 1, 224: 0 1, 225: 1, 226: 1, 227: 1, 228: 1, 229: 1, 230: 1, 231: 1, 232: 1, 233: 1, 234: 1, 235: 1, 236: 1, 237: 1, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 1, 250: 1, 251: 1 0, 252: 1 0, 253: 0, 254: 0, 255: 0 1 11:35:52,861 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #8, conn_id=2) 11:35:52,861 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeB-51742#8 11:35:52,861 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t6) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,861 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t6) Updating cluster-wide current topology for cache dist, topology = CacheTopology{id=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, availability mode = AVAILABLE 11:35:52,861 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} 11:35:52,860 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=3 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1110, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,861 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t6) Waiting on view 3 being accepted 11:35:52,861 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #8, conn_id=2) 11:35:52,861 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeD-43076#8 11:35:52,861 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t6) Updating local topology for cache dist: CacheTopology{id=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,861 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: Responses{ NodeD-43076: sender=NodeD-43076value=CacheNotFoundResponse, received=true, suspected=false} 11:35:52,861 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeB-51742) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} is {NodeD-43076=CacheNotFoundResponse} 11:35:52,861 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t6) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0 1, 13: 0 1, 14: 1, 15: 1, 16: 1, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0, 31: 0, 32: 1, 33: 1, 34: 1, 35: 1, 36: 1, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 1, 52: 1, 53: 1, 54: 1 0, 55: 1 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1, 76: 0, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1, 83: 0, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0, 89: 0 1, 90: 0 1, 91: 1, 92: 1, 93: 0, 94: 0 1, 95: 0 1, 96: 1, 97: 1, 98: 1, 99: 1, 100: 1, 101: 1, 102: 1, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0, 116: 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1, 128: 0, 129: 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0, 134: 0, 135: 1, 136: 1, 137: 1, 138: 1, 139: 1, 140: 1, 141: 1, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1 0, 147: 1 0, 148: 0, 149: 0, 150: 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1, 155: 1, 156: 1, 157: 1, 158: 1 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0, 173: 0, 174: 0 1, 175: 0 1, 176: 1, 177: 1, 178: 1, 179: 1, 180: 1, 181: 1, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0 1, 188: 1, 189: 1, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0, 195: 0, 196: 0, 197: 0 1, 198: 1, 199: 1, 200: 1, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1, 206: 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0 1, 224: 0 1, 225: 1, 226: 1, 227: 1, 228: 1, 229: 1, 230: 1, 231: 1, 232: 1, 233: 1, 234: 1, 235: 1, 236: 1, 237: 1, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 1, 250: 1, 251: 1 0, 252: 1 0, 253: 0, 254: 0, 255: 0 1 11:35:52,863 WARN [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) ISPN000210: Failed to request segments [128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254] of cache dist from node NodeD-43076 (node will not be retried) 11:35:52,863 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254], finishedSegments=[], unfinishedSegments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254], source=NodeD-43076, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@435468f7[Completed exceptionally], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,863 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Retrying failed task: InboundTransferTask{segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254], finishedSegments=[], unfinishedSegments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254], source=NodeD-43076, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@435468f7[Completed exceptionally], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,863 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) Cancelling inbound state transfer of segments [128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254] of cache dist 11:35:52,863 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} to recipient list [NodeD-43076] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=PER_SENDER, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,863 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeB-p427-t1) dests=[NodeD-43076], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]}, mode=ASYNCHRONOUS, timeout=60000 11:35:52,863 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeB-p427-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} to single recipient NodeD-43076 with response mode GET_NONE 11:35:52,863 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 --> DATA(NodeD-43076: #10, conn_id=2) 11:35:52,863 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,863 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} is {} 11:35:52,863 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (319 bytes (1595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,863 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (322 bytes) 11:35:52,863 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (3 headers), size=248 bytes, flags=NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,863 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeD-43076) NodeD-43076 <-- DATA(NodeB-51742: #10, conn_id=2) 11:35:52,858 TRACE [org.infinispan.transaction.impl.LocalTransaction] (stateTransferExecutor-threadNodeA-p411-t2) Adding modification PutKeyValueCommand{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedMetadata{version=null}, successful=true}. Mod list is null 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Applying new state chunk for segment 139 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Finished applying chunk of segment 139 of cache dist 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Applying new state chunk for segment 140 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Finished applying chunk of segment 140 of cache dist 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Applying new state chunk for segment 15 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Finished applying chunk of segment 15 of cache dist 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 200 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 200 of cache dist 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 138 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 138 of cache dist 11:35:52,857 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t1) Removing no longer owned entries for cache dist 11:35:52,868 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) Topology changed, recalculating minTopologyId 11:35:52,868 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t1) Changing minimum topology ID from 8 to 9 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Applying new state chunk for segment 16 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,864 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 137 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,868 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 137 of cache dist 11:35:52,868 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeA-p411-t2) beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.synchronization.SyncLocalTransaction@1b 11:35:52,868 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-threadNodeA-p411-t2) Sending prepare command through the chain: PrepareCommand {modifications=null, onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:27, cacheName='dist', topologyId=-1} 11:35:52,863 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeD-43076) NodeD-43076: delivering #10 - #10 (1 messages) 11:35:52,863 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Removing inbound transfers for segments [128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254] from source NodeD-43076 for cache dist 11:35:52,861 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t6) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,861 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t6) dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:52,861 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: sender=NodeB-51742value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:52,869 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=GET_TRANSACTIONS, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} is {NodeB-51742=SuccessfulResponse{responseValue=[]} } 11:35:52,869 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Applying 0 transactions for cache dist transferred from node NodeB-51742 11:35:52,869 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:52,868 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t6) Union consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 1 0, 36: 1 0, 37: 0 1, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 0 1, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 0 1, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 0 1, 143: 0 1, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 0 1, 183: 0 1, 184: 0 1, 185: 0 1, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 0 1, 239: 0 1, 240: 0 1, 241: 0 1, 242: 0 1, 243: 0 1, 244: 0 1, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,869 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) Requesting segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] of cache dist from node NodeA-45995 11:35:52,869 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 invoking StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,869 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeB-p427-t1) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,869 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeB-p427-t1) Replication task sending StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} to addresses [NodeA-45995] with response mode GET_ALL 11:35:52,869 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: invoking multicast RPC [req-id=1116] 11:35:52,869 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742 --> DATA(NodeA-45995: #23, conn_id=0) 11:35:52,869 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeB-p427-t1) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1116, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 11:35:52,868 TRACE [org.jgroups.blocks.RequestCorrelator] (Incoming-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,869 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (296 bytes (1480.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,869 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (299 bytes) 11:35:52,870 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=223 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1116, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 11:35:52,870 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #23, conn_id=0) 11:35:52,870 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#23 11:35:52,870 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1116 11:35:52,870 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} [sender=NodeB-51742] 11:35:52,870 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,870 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t4) Calling perform() on StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} 11:35:52,868 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) Invoked with command PrepareCommand {modifications=null, onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:27, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6307d2da] 11:35:52,870 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) handleTxCommand for command PrepareCommand {modifications=null, onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeA-45995:27, cacheName='dist', topologyId=-1}, origin null 11:35:52,870 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) Invoking: PrepareCommand 11:35:52,870 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeA-p411-t2) afterCompletion(3) called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.synchronization.SyncLocalTransaction@1b. 11:35:52,870 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-threadNodeA-p411-t2) Committing transaction GlobalTx:NodeA-45995:27 11:35:52,870 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) Invoked with command CommitCommand {gtx=GlobalTx:NodeA-45995:27, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@2627f8f7] 11:35:52,870 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeA-45995:27, cacheName='dist', topologyId=-1}, origin null 11:35:52,868 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Finished applying chunk of segment 16 of cache dist 11:35:52,870 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) Invoking: CommitCommand 11:35:52,871 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Applying new state chunk for segment 34 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,871 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 32 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,871 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-threadNodeA-p411-t2) About to commit entry ReadCommittedEntry(2605587e){key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=null}} 11:35:52,870 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t4) Starting outbound transfer of segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] to node NodeB-51742 with topology id 9 for cache dist 11:35:52,869 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t6) Installing new cache topology CacheTopology{id=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+115, NodeB-51742: 115+141]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:52,869 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-threadNodeA-p406-t6) NodeA-45995: sending NodeA-45995#14 11:35:52,871 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (Incoming-1,NodeD-43076) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeB-51742, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[128, 129, 195, 6, 8, 11, 76, 142, 206, 83, 148, 150, 88, 93, 30, 222, 162, 37, 103, 104, 105, 42, 106, 44, 45, 173, 238, 239, 240, 49, 241, 115, 116, 182, 246, 183, 247, 184, 185, 186, 60, 254]} [sender=NodeB-51742] 11:35:52,871 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (Incoming-1,NodeD-43076) Silently ignoring that dist cache is not defined 11:35:52,871 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 11:35:52,871 TRACE [org.jgroups.protocols.MFC] (remote-threadNodeA-p406-t6) NodeA-45995 used 5839 credits, 1949195 remaining 11:35:52,871 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Queueing rebalance for cache dist with members [NodeA-45995, NodeB-51742] 11:35:52,871 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Adding transfer from NodeA-45995 for segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] 11:35:52,874 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Adding transfer from NodeB-51742 for segments [66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63] 11:35:52,874 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Finished adding inbound state transfer for segments [12, 54, 55, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 84, 85, 89, 90, 94, 117, 118, 119, 125, 126, 130, 131, 132, 151, 152, 153, 158, 165, 166, 167, 168, 169, 174, 175, 187, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 252] of cache dist 11:35:52,874 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Topology update processed, stateTransferTopologyId = 9, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[NodeA-45995: 86+170, NodeB-51742: 80+176, NodeD-43076: 90+166]} 11:35:52,874 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeD-p532-t5) Signalling transaction data received for topology 9 11:35:52,875 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,875 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,875 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeD-p532-t5) Removing no longer owned entries for cache dist 11:35:52,875 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) Topology changed, recalculating minTopologyId 11:35:52,875 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeD-p532-t5) Changing minimum topology ID from 8 to 9 11:35:52,871 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeA-p411-t2) Trying to commit. Key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. Operation Flag=PUT_FOR_STATE_TRANSFER, L1 invalidation=false 11:35:52,875 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-threadNodeA-p411-t2) Creating new ICE for writing. Existing=null, metadata=EmbeddedMetadata{version=null}, new value=v3 11:35:52,875 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-threadNodeA-p411-t2) Store ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} in container 11:35:52,875 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeA-p411-t2) Committed key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 11:35:52,875 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-threadNodeA-p411-t2) Release locks for keys=[]. owner=GlobalTx:NodeA-45995:27 11:35:52,875 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-threadNodeA-p411-t2) Clearing locked keys: [] 11:35:52,875 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeA-p411-t2) Removed LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.synchronization.SyncLocalTransaction@1b from transaction table. 11:35:52,875 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-threadNodeA-p411-t2) Transaction GlobalTx:NodeA-45995:27 has completed, notifying listening threads. 11:35:52,875 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeA-p411-t2) Committed in onePhase? false isOptimistic? true 11:35:52,875 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t4) Adding outbound transfer of segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] to NodeB-51742 11:35:52,875 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 33 of cache dist 11:35:52,875 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t4) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} 11:35:52,875 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t4) sending rsp for 1116 to NodeB-51742 11:35:52,875 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t3) Sending last chunk containing 1 cache entries from segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] of cache dist to node NodeB-51742 11:35:52,875 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t4) NodeA-45995 --> DATA(NodeB-51742: #17, conn_id=1) 11:35:52,875 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t4) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1116, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,871 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 157 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,875 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t3) NodeA-45995 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=194, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,871 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 32 of cache dist 11:35:52,875 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t3) dests=[NodeB-51742], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=194, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9}, mode=SYNCHRONOUS, timeout=240000 11:35:52,871 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 145 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,875 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 145 of cache dist 11:35:52,875 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t3) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=194, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} to single recipient NodeB-51742 with response mode GET_ALL 11:35:52,875 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t3) NodeA-45995: invoking unicast RPC [req-id=1119] on NodeB-51742 11:35:52,875 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t3) NodeA-45995 --> DATA(NodeB-51742: #18, conn_id=1) 11:35:52,875 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t3) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1119, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,875 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Finished applying chunk of segment 34 of cache dist 11:35:52,876 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 99 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,876 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 99 of cache dist 11:35:52,874 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t3) Requesting segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist from node NodeA-45995 11:35:52,877 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeD-p553-t3) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,877 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeD-p553-t3) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,877 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeD-p553-t3) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} to addresses [NodeA-45995] with response mode GET_ALL 11:35:52,878 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeD-p553-t3) NodeD-43076: invoking multicast RPC [req-id=1121] 11:35:52,878 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeD-p553-t3) NodeD-43076 --> DATA(NodeA-45995: #22, conn_id=0) 11:35:52,878 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeD-p553-t3) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1121, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 11:35:52,878 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (291 bytes (1455.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,878 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (294 bytes) 11:35:52,878 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 157 of cache dist 11:35:52,878 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=218 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1121, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 11:35:52,878 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #22, conn_id=0) 11:35:52,878 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#22 11:35:52,878 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1121 11:35:52,878 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} [sender=NodeD-43076] 11:35:52,878 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,878 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t4) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} 11:35:52,878 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t4) Starting outbound transfer of segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] to node NodeD-43076 with topology id 9 for cache dist 11:35:52,878 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeA-p406-t4) Adding outbound transfer of segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] to NodeD-43076 11:35:52,878 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t4) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} 11:35:52,871 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (5890 bytes (29450.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:52,878 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t5) Sending last chunk containing 0 cache entries from segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist to node NodeD-43076 11:35:52,878 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t4) sending rsp for 1121 to NodeD-43076 11:35:52,878 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t4) NodeA-45995 --> DATA(NodeD-43076: #17, conn_id=3) 11:35:52,871 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Postponing rebalance for cache dist, there's already a rebalance in progress: RebalanceConfirmationCollector{cacheName=disttopologyId=9, confirmationsNeeded=[NodeD-43076, NodeA-45995, NodeB-51742]} 11:35:52,878 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t5) NodeA-45995 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} to recipient list [NodeD-43076] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,878 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t4) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1121, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,878 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t5) dests=[NodeD-43076], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9}, mode=SYNCHRONOUS, timeout=240000 11:35:52,878 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t5) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} to single recipient NodeD-43076 with response mode GET_ALL 11:35:52,871 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=10, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+115, NodeB-51742: 115+141]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,878 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t6) Signalling topology 10 is installed 11:35:52,878 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t5) NodeA-45995: invoking unicast RPC [req-id=1122] on NodeD-43076 11:35:52,878 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t5) NodeA-45995 --> DATA(NodeD-43076: #18, conn_id=3) 11:35:52,878 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1122, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,878 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:52,878 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) On cache dist we have: added segments: []; removed segments: [] 11:35:52,879 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Removing inbound transfers from source NodeD-43076 for cache dist 11:35:52,879 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Removing inbound transfers for segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] from source NodeD-43076 for cache dist 11:35:52,879 TRACE [org.infinispan.statetransfer.InboundTransferTask] (transport-threadNodeA-p408-t6) Cancelling inbound state transfer of segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist 11:35:52,879 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t6) NodeA-45995 invoking StateRequestCommand{cache=dist, origin=NodeA-45995, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to recipient list [NodeD-43076] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=PER_SENDER, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,879 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t6) dests=[NodeD-43076], command=StateRequestCommand{cache=dist, origin=NodeA-45995, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]}, mode=ASYNCHRONOUS, timeout=60000 11:35:52,879 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t6) Replication task sending StateRequestCommand{cache=dist, origin=NodeA-45995, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to single recipient NodeD-43076 with response mode GET_NONE 11:35:52,879 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t6) NodeA-45995 --> DATA(NodeD-43076: #19, conn_id=3) 11:35:52,879 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t6) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=19, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,879 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t6) Response(s) to StateRequestCommand{cache=dist, origin=NodeA-45995, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} is {} 11:35:52,879 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Inbound transfer finished: InboundTransferTask{segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], finishedSegments=[32, 33, 34, 99, 198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157], unfinishedSegments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], source=NodeD-43076, isCancelled=true, completionFuture=java.util.concurrent.CompletableFuture@691b60b6[Completed exceptionally], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,879 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Removing inbound transfers for segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] from source NodeD-43076 for cache dist 11:35:52,879 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Adding inbound state transfer for segments [35, 51, 52, 53, 100, 164, 179, 180, 226, 229, 233, 236, 249, 250] of cache dist 11:35:52,879 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Requesting transactions for segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist from node NodeB-51742 11:35:52,879 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeA-p408-t6) NodeA-45995 invoking StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,879 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t6) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]}, mode=SYNCHRONOUS, timeout=240000 11:35:52,879 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t6) Replication task sending StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to single recipient NodeB-51742 with response mode GET_ALL 11:35:52,879 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t6) NodeA-45995: invoking unicast RPC [req-id=1123] on NodeB-51742 11:35:52,879 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t6) NodeA-45995 --> DATA(NodeB-51742: #19, conn_id=1) 11:35:52,879 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1123, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,878 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 35 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,878 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (5893 bytes) 11:35:52,880 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t6) Rebalance confirmation collector 9@dist members list updated, remaining list is [NodeA-45995, NodeB-51742] 11:35:52,880 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (5893 bytes) 11:35:52,880 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (5893 bytes) 11:35:52,880 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=5839 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 11:35:52,880 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: received NodeA-45995#14 11:35:52,880 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=5839 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 11:35:52,880 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#14 11:35:52,880 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#14 11:35:52,880 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=5839 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 11:35:52,880 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: received NodeA-45995#14 11:35:52,880 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#14 11:35:52,880 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,880 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,876 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 226 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,880 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 226 of cache dist 11:35:52,880 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-threadNodeD-p530-t5) Ignoring consistent hash update 10 for cache dist that doesn't exist locally 11:35:52,876 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Applying new state chunk for segment 100 of cache dist from node NodeD-43076: received 0 cache entries 11:35:52,880 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Finished applying chunk of segment 100 of cache dist 11:35:52,880 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,881 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeD-43076) NodeA-45995 used 5839 credits, 1965402 remaining 11:35:52,881 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 229 of cache dist 11:35:52,881 WARN [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 233 of cache dist 11:35:52,881 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 236 of cache dist 11:35:52,880 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 6 msgs (1621 bytes (8105.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeD-43076, ISPN:NodeB-51742] 11:35:52,880 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,880 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#14 11:35:52,881 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (649 bytes) 11:35:52,880 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 35 of cache dist 11:35:52,881 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (802 bytes) 11:35:52,881 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,881 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1116, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,881 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=556 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1119, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,881 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #17, conn_id=1) 11:35:52,881 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #18, conn_id=1) 11:35:52,881 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#17 11:35:52,881 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeB-51742) NodeB-51742: delivering NodeA-45995#18 11:35:52,881 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=325 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1122, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,881 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 164 of cache dist 11:35:52,881 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #18, conn_id=3) 11:35:52,881 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#18 11:35:52,881 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1122 11:35:52,881 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeD-43076) NodeD-43076: received message batch of 1 messages from NodeA-45995 11:35:52,881 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-3,NodeB-51742) Responses: Responses{ NodeA-45995: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,881 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1119 11:35:52,881 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} [sender=NodeA-45995] 11:35:52,881 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1121, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,881 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Silently ignoring that dist cache is not defined 11:35:52,881 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-threadNodeC-p458-t6) Ignoring consistent hash update 10 for cache dist that doesn't exist locally 11:35:52,881 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,882 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeB-51742) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=194, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} [sender=NodeA-45995] 11:35:52,882 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-2,NodeB-51742) Checking if transaction data was received for topology 0, current topology is 9 11:35:52,881 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,882 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,882 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 51 of cache dist 11:35:52,882 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,882 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 179 of cache dist 11:35:52,882 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 52 of cache dist 11:35:52,882 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=194, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} 11:35:52,882 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Before applying the received state the data container of cache dist has 2 keys 11:35:52,882 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-4,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=108 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1123, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,882 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,882 TRACE [org.jgroups.protocols.UNICAST3] (OOB-4,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #19, conn_id=1) 11:35:52,882 TRACE [org.jgroups.protocols.UNICAST3] (OOB-4,NodeB-51742) NodeB-51742: delivering NodeA-45995#19 11:35:52,882 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-4,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1123 11:35:52,882 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 133 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,882 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 133 of cache dist 11:35:52,882 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-4,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} [sender=NodeA-45995] 11:35:52,882 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-4,NodeB-51742) Added a new task to the queue: 1 task(s) are waiting 11:35:52,882 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-threadNodeB) Tasks to be executed=0, still pending=~1 11:35:52,882 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t3) Waiting on view 3 being accepted 11:35:52,882 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t3) Updating local topology for cache dist: CacheTopology{id=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,882 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t3) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0 1, 13: 0 1, 14: 1, 15: 1, 16: 1, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0, 31: 0, 32: 1, 33: 1, 34: 1, 35: 1, 36: 1, 37: 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 1, 52: 1, 53: 1, 54: 1 0, 55: 1 0, 56: 0, 57: 0, 58: 0, 59: 0, 60: 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1, 76: 0, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1, 83: 0, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0, 89: 0 1, 90: 0 1, 91: 1, 92: 1, 93: 0, 94: 0 1, 95: 0 1, 96: 1, 97: 1, 98: 1, 99: 1, 100: 1, 101: 1, 102: 1, 103: 0, 104: 0, 105: 0, 106: 0, 107: 0, 108: 0, 109: 0, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0, 116: 0, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1, 128: 0, 129: 0, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0, 134: 0, 135: 1, 136: 1, 137: 1, 138: 1, 139: 1, 140: 1, 141: 1, 142: 0, 143: 0, 144: 0, 145: 1, 146: 1 0, 147: 1 0, 148: 0, 149: 0, 150: 0, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1, 155: 1, 156: 1, 157: 1, 158: 1 0, 159: 0, 160: 0, 161: 0, 162: 0, 163: 0, 164: 1, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0, 173: 0, 174: 0 1, 175: 0 1, 176: 1, 177: 1, 178: 1, 179: 1, 180: 1, 181: 1, 182: 0, 183: 0, 184: 0, 185: 0, 186: 0, 187: 0 1, 188: 1, 189: 1, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0, 195: 0, 196: 0, 197: 0 1, 198: 1, 199: 1, 200: 1, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1, 206: 0, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0, 220: 0, 221: 0, 222: 0, 223: 0 1, 224: 0 1, 225: 1, 226: 1, 227: 1, 228: 1, 229: 1, 230: 1, 231: 1, 232: 1, 233: 1, 234: 1, 235: 1, 236: 1, 237: 1, 238: 0, 239: 0, 240: 0, 241: 0, 242: 0, 243: 0, 244: 0, 245: 0, 246: 0, 247: 0, 248: 0, 249: 1, 250: 1, 251: 1 0, 252: 1 0, 253: 0, 254: 0, 255: 0 1 11:35:52,882 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t3) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,882 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t4) Requesting segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] of cache dist from node NodeB-51742 11:35:52,887 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995 invoking StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,887 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 5839 credits, 1949195 remaining 11:35:52,887 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeA-p411-t4) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,881 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (OOB-2,NodeD-43076) About to send back response CacheNotFoundResponse for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} 11:35:52,887 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeA-p411-t4) Replication task sending StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} to addresses [NodeB-51742] with response mode GET_ALL 11:35:52,887 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) sending rsp for 1122 to NodeA-45995 11:35:52,887 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 --> DATA(NodeA-45995: #23, conn_id=0) 11:35:52,887 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995: invoking multicast RPC [req-id=1126] 11:35:52,881 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #19 - #19) 11:35:52,881 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-3,NodeB-51742) Response(s) to StateRequestCommand{cache=dist, origin=NodeB-51742, type=START_STATE_TRANSFER, topologyId=9, segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253]} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,887 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t1) Successfully requested segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] of cache dist from node NodeA-45995 11:35:52,887 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995 --> DATA(NodeB-51742: #20, conn_id=1) 11:35:52,887 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253], finishedSegments=[133], unfinishedSegments=[194, 196, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7047aa14[Not completed], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,887 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1126, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,887 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (276 bytes (1380.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,887 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (279 bytes) 11:35:52,887 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #17, conn_id=3) 11:35:52,887 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering NodeA-45995#17 11:35:52,887 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeD-43076) Responses: Responses{ NodeA-45995: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,887 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeD-43076) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=START_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,887 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeD-43076) NodeD-43076: delivering #19 - #19 (1 messages) 11:35:52,887 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=203 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1126, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,887 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #20, conn_id=1) 11:35:52,887 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,887 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#20 11:35:52,887 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1126 11:35:52,887 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeA-45995, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} [sender=NodeA-45995] 11:35:52,887 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeD-43076) Silently ignoring that dist cache is not defined 11:35:52,887 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} [sender=NodeA-45995] 11:35:52,887 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1122, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 11:35:52,887 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 1 task(s) are waiting 11:35:52,887 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (76 bytes (380.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,887 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (79 bytes) 11:35:52,887 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t6) Calling perform() on StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} 11:35:52,887 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t6) Starting outbound transfer of segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] to node NodeA-45995 with topology id 9 for cache dist 11:35:52,888 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=3 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1122, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 11:35:52,888 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #23, conn_id=0) 11:35:52,882 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t3) Union consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 1 0, 33: 1 0, 34: 1 0, 35: 1 0, 36: 1 0, 37: 0 1, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 0 1, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 0 1, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 0 1, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 0 1, 143: 0 1, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 0 1, 152: 0 1, 153: 0 1, 154: 1 0, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 0 1, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 1 0, 165: 1 0, 166: 1 0, 167: 1 0, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 0 1, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 0 1, 183: 0 1, 184: 0 1, 185: 0 1, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 1 0, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 0 1, 239: 0 1, 240: 0 1, 241: 0 1, 242: 0 1, 243: 0 1, 244: 0 1, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,882 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 196 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 196 of cache dist 11:35:52,882 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 134 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 134 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t3) Installing new cache topology CacheTopology{id=10, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+115, NodeB-51742: 115+141]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 7 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 7 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 143 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 143 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Applying new state chunk for segment 144 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 149 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 149 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 219 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 219 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 220 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 220 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 221 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 221 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 31 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 31 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 159 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 159 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 160 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 160 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 161 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 161 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 163 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 163 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 43 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 43 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 107 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 107 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 108 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 108 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 172 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 172 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 109 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 109 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 46 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 46 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 47 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 47 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 48 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 48 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 50 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 50 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 242 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 242 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 243 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 243 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 244 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 244 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 245 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 245 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 56 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 56 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 248 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 248 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 57 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 57 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 58 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 58 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 59 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 59 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Applying new state chunk for segment 253 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Finished applying chunk of segment 253 of cache dist 11:35:52,882 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Applying new state chunk for segment 194 of cache dist from node NodeA-45995: received 1 cache entries 11:35:52,882 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeB-51742) NodeA-45995 used 5839 credits, 1949195 remaining 11:35:52,882 WARN [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 180 of cache dist 11:35:52,882 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response SuccessfulResponse{responseValue=null} for command CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=NodeD-43076, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} 11:35:52,888 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 53 of cache dist 11:35:52,888 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 250 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Applying new state chunk for segment 9 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t1) Finished applying chunk of segment 9 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Applying new state chunk for segment 10 of cache dist from node NodeA-45995: received 0 cache entries 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t3) Finished applying chunk of segment 144 of cache dist 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=10, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+115, NodeB-51742: 115+141]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,888 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeD-43076#23 11:35:52,889 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: sender=NodeD-43076value=CacheNotFoundResponse, received=true, suspected=false 11:35:52,888 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t6) Adding outbound transfer of segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] to NodeA-45995 11:35:52,894 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t4) Sending last chunk containing 0 cache entries from segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] of cache dist to node NodeA-45995 11:35:52,894 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t6) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} 11:35:52,894 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeB-p417-t4) NodeB-51742 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=9} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,887 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeD-p553-t3) Successfully requested segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist from node NodeA-45995 11:35:52,894 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeD-p553-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126], finishedSegments=[], unfinishedSegments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@73035e49[Not completed], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,894 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t4) dests=[NodeA-45995], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=9}, mode=SYNCHRONOUS, timeout=240000 11:35:52,894 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t6) sending rsp for 1126 to NodeA-45995 11:35:52,894 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t6) NodeB-51742 --> DATA(NodeA-45995: #24, conn_id=0) 11:35:52,889 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Replication exception org.infinispan.remoting.transport.jgroups.SuspectException: Cache not running on node NodeD-43076 11:35:52,894 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t6) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1126, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 11:35:52,894 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,889 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling topology 10 is installed 11:35:52,895 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:52,895 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-threadNodeB) Tasks to be executed=1, still pending=~1 11:35:52,888 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t2) Finished applying chunk of segment 10 of cache dist 11:35:52,897 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t6) Calling perform() on StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,897 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t6) Received request for transactions from node NodeA-45995 for segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist with topology id 10 11:35:52,898 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t6) Found 0 transaction(s) to transfer 11:35:52,888 WARN [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) ISPN000396: Received unsolicited state from node NodeD-43076 for segment 249 of cache dist 11:35:52,888 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeB-p427-t4) Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=null} org.infinispan.transaction.synchronization.SyncLocalTransaction@1c 11:35:52,898 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) After applying the received state the data container of cache dist has 4 keys 11:35:52,898 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t5) Segments not received yet for cache dist: {NodeB-51742=[InboundTransferTask{segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127], finishedSegments=[], unfinishedSegments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3ed5519[Not completed], topologyId=9, timeout=240000, cacheName=dist}]} 11:35:52,898 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) Invoked with command PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedMetadata{version=null}, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@3ae27a26] 11:35:52,898 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedMetadata{version=null}, successful=true}, origin null 11:35:52,898 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t5) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=33, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeD-43076, topologyId=9} 11:35:52,898 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 1108 to NodeD-43076 11:35:52,898 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t5) sending rsp for 1106 to NodeD-43076 11:35:52,898 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t5) NodeA-45995 --> DATA(NodeD-43076: #21, conn_id=3) 11:35:52,898 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeB-p427-t4) Exists in context? null 11:35:52,898 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeB-p427-t4) Retrieved from container null 11:35:52,898 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t5) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1106, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,898 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeB-p427-t4) Creating new entry for key MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} 11:35:52,898 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-threadNodeB-p427-t4) Updated context entry ReadCommittedEntry(3eddf9a2){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=null, isCreated=true, isChanged=false, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=null} 11:35:52,898 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) Invoking: PutKeyValueCommand 11:35:52,898 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,898 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t6) About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,898 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (78 bytes) 11:35:52,898 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t6) sending rsp for 1123 to NodeA-45995 11:35:52,898 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t6) NodeB-51742 --> DATA(NodeA-45995: #25, conn_id=0) 11:35:52,898 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t6) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1123, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 11:35:52,897 DEBUG [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t5) Node NodeD-43076 left cache dist while we were sending state to it, cancelling transfer. 11:35:52,898 DEBUG [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t5) Cancelling outbound transfer of segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist to node NodeD-43076 11:35:52,898 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeA-p408-t5) Removing cancelled outbound transfer of segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] to NodeD-43076 for cache dist 11:35:52,898 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t5) Outbound transfer of segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist to node NodeD-43076 is complete 11:35:52,898 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1106, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,898 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #21, conn_id=3) 11:35:52,898 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#21 11:35:52,898 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeD-43076) Responses: sender=NodeA-45995, received=true, suspected=false 11:35:52,898 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeD-43076) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=33, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeD-43076, topologyId=9} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,898 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeD-p532-t6) Outbound transfer of segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist to node NodeA-45995 is complete 11:35:52,895 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: added segments: []; removed segments: [] 11:35:52,898 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeD-p532-t6) Removing completed outbound transfer of segments [198, 135, 136, 200, 137, 138, 139, 140, 15, 16, 145, 157, 32, 33, 34, 226, 35, 99, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] to NodeA-45995 for cache dist 11:35:52,898 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Topology update processed, stateTransferTopologyId = 9, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]} 11:35:52,898 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling transaction data received for topology 10 11:35:52,898 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,898 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,898 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Removing no longer owned entries for cache dist 11:35:52,898 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Topology changed, recalculating minTopologyId 11:35:52,898 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Minimum topology ID still is 9; nothing to change 11:35:52,894 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (80 bytes) 11:35:52,899 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t4) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=9} to single recipient NodeA-45995 with response mode GET_ALL 11:35:52,899 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeB-p417-t4) NodeB-51742: invoking unicast RPC [req-id=1128] on NodeA-45995 11:35:52,899 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,899 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (84 bytes) 11:35:52,899 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1123, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 11:35:52,899 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #25, conn_id=0) 11:35:52,899 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#25 11:35:52,899 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeA-45995) Responses: sender=NodeB-51742value=SuccessfulResponse{responseValue=[]} , received=true, suspected=false 11:35:52,899 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeA-45995) Response(s) to StateRequestCommand{cache=dist, origin=NodeA-45995, type=GET_TRANSACTIONS, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} is {NodeB-51742=SuccessfulResponse{responseValue=[]} } 11:35:52,899 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Applying 0 transactions for cache dist transferred from node NodeB-51742 11:35:52,900 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Adding transfer from NodeB-51742 for segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] 11:35:52,898 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) The return value is null 11:35:52,900 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-threadNodeB-p427-t4) Release locks for keys=[]. owner=GlobalTx:NodeB-51742:28 11:35:52,900 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-threadNodeB-p427-t4) Clearing locked keys: [] 11:35:52,898 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeD-43076: #20, conn_id=3) 11:35:52,900 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1108, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,900 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (77 bytes (385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,900 TRACE [org.infinispan.transaction.impl.LocalTransaction] (stateTransferExecutor-threadNodeB-p427-t4) Adding modification PutKeyValueCommand{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedMetadata{version=null}, successful=true}. Mod list is null 11:35:52,900 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Finished adding inbound state transfer for segments [35, 51, 52, 53, 100, 164, 179, 180, 226, 229, 233, 236, 249, 250] of cache dist 11:35:52,900 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Topology update processed, stateTransferTopologyId = 9, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]} 11:35:52,900 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t6) Signalling transaction data received for topology 10 11:35:52,900 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeB-p427-t4) beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.synchronization.SyncLocalTransaction@1c 11:35:52,899 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1126, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 11:35:52,901 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t4) NodeB-51742 --> DATA(NodeA-45995: #26, conn_id=0) 11:35:52,901 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t4) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1128, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 11:35:52,901 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (374 bytes (1870.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,901 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (377 bytes) 11:35:52,900 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-threadNodeB-p427-t4) Sending prepare command through the chain: PrepareCommand {modifications=null, onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:28, cacheName='dist', topologyId=-1} 11:35:52,900 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t6) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,901 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t6) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,901 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) Invoked with command PrepareCommand {modifications=null, onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:28, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@7bdf701d] 11:35:52,901 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) handleTxCommand for command PrepareCommand {modifications=null, onePhaseCommit=false, retried=false, gtx=GlobalTx:NodeB-51742:28, cacheName='dist', topologyId=-1}, origin null 11:35:52,901 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t6) Removing no longer owned entries for cache dist 11:35:52,901 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t6) Topology changed, recalculating minTopologyId 11:35:52,901 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) Invoking: PrepareCommand 11:35:52,901 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeB-p427-t4) afterCompletion(3) called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.synchronization.SyncLocalTransaction@1c. 11:35:52,901 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t6) Changing minimum topology ID from 9 to 10 11:35:52,901 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #24, conn_id=0) 11:35:52,901 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#24 11:35:52,901 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=301 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1128, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 11:35:52,901 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #26, conn_id=0) 11:35:52,901 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#26 11:35:52,901 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1128 11:35:52,901 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: Responses{ NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,901 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-2,NodeA-45995) Response(s) to StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=9, segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127]} is {NodeB-51742=SuccessfulResponse{responseValue=null} } 11:35:52,901 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t4) Successfully requested segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] of cache dist from node NodeB-51742 11:35:52,901 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=9} [sender=NodeB-51742] 11:35:52,901 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127], finishedSegments=[], unfinishedSegments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3ed5519[Not completed], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,901 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeA-45995) Checking if transaction data was received for topology 0, current topology is 10 11:35:52,901 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,901 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t6) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=9} 11:35:52,902 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Before applying the received state the data container of cache dist has 4 keys 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 14 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 14 of cache dist 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 82 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 75 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 75 of cache dist 11:35:52,901 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (80 bytes) 11:35:52,905 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1108, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=3, TP: [cluster_name=ISPN] 11:35:52,905 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076 <-- DATA(NodeA-45995: #20, conn_id=3) 11:35:52,905 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#20 11:35:52,905 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeD-43076) Responses: sender=NodeA-45995value=SuccessfulResponse{responseValue=null} , received=true, suspected=false 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Shutting down StateConsumer of cache dist on node NodeD-43076 11:35:52,905 TRACE [org.infinispan.statetransfer.InboundTransferTask] (testng) Cancelling inbound state transfer of segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] of cache dist 11:35:52,905 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} to recipient list [NodeA-45995] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=PER_SENDER, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,905 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeA-45995], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]}, mode=ASYNCHRONOUS, timeout=60000 11:35:52,905 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} to single recipient NodeA-45995 with response mode GET_NONE 11:35:52,905 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #24, conn_id=0) 11:35:52,905 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 11:35:52,905 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} is {} 11:35:52,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (289 bytes (1445.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (292 bytes) 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Inbound transfer finished: InboundTransferTask{segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126], finishedSegments=[], unfinishedSegments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126], source=NodeA-45995, isCancelled=true, completionFuture=java.util.concurrent.CompletableFuture@73035e49[Completed exceptionally], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 205 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (testng) Removing inbound transfers for segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] from source NodeA-45995 for cache dist 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 205 of cache dist 11:35:52,901 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-threadNodeB-p427-t4) Committing transaction GlobalTx:NodeB-51742:28 11:35:52,905 TRACE [org.infinispan.statetransfer.InboundTransferTask] (testng) Cancelling inbound state transfer of segments [66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63] of cache dist 11:35:52,905 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) NodeD-43076 invoking StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} to recipient list [NodeB-51742] with options RpcOptions{timeout=60000, unit=MILLISECONDS, deliverOrder=PER_SENDER, responseFilter=null, responseMode=ASYNCHRONOUS} 11:35:52,905 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]}, mode=ASYNCHRONOUS, timeout=60000 11:35:52,905 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (testng) Replication task sending StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} to single recipient NodeB-51742 with response mode GET_NONE 11:35:52,905 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeB-51742: #9, conn_id=2) 11:35:52,906 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,906 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (testng) Response(s) to StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} is {} 11:35:52,906 TRACE [org.infinispan.statetransfer.StateProviderImpl] (testng) Shutting down StateProvider of cache dist on node NodeD-43076 11:35:52,906 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (204 bytes (1020.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,906 TRACE [org.infinispan.jmx.ComponentsJmxRegistration] (testng) Unregistering jmx resources.. 11:35:52,906 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (207 bytes) 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute storeWrites [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:52,906 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeD-43076 (3 headers), size=133 bytes, flags=NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 11:35:52,906 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742 <-- DATA(NodeD-43076: #9, conn_id=2) 11:35:52,906 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742: delivering #9 - #9 (1 messages) 11:35:52,906 TRACE [org.jgroups.blocks.RequestCorrelator] (Incoming-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 141 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 141 of cache dist 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 82 of cache dist 11:35:52,905 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 199 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 199 of cache dist 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 156 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 155 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 155 of cache dist 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 91 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 91 of cache dist 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 92 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 92 of cache dist 11:35:52,907 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 154 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,907 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 154 of cache dist 11:35:52,906 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (Incoming-1,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} [sender=NodeD-43076] 11:35:52,907 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (Incoming-1,NodeB-51742) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63]} 11:35:52,907 TRACE [org.infinispan.statetransfer.StateProviderImpl] (Incoming-1,NodeB-51742) Cancelling outbound transfer of segments [66, 132, 165, 166, 71, 167, 72, 168, 169, 211, 212, 54, 55, 217, 218, 252, 125, 158, 63] to node NodeD-43076 with topology id 9 for cache dist 11:35:52,906 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:52,905 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) Invoked with command CommitCommand {gtx=GlobalTx:NodeB-51742:28, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@63f4ceb6] 11:35:52,905 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=218 bytes, flags=NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 11:35:52,907 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) handleTxCommand for command CommitCommand {gtx=GlobalTx:NodeB-51742:28, cacheName='dist', topologyId=-1}, origin null 11:35:52,907 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #24, conn_id=0) 11:35:52,907 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) Invoking: CommitCommand 11:35:52,907 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995: delivering #24 - #24 (1 messages) 11:35:52,907 TRACE [org.jgroups.blocks.RequestCorrelator] (Incoming-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,907 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-threadNodeB-p427-t4) About to commit entry ReadCommittedEntry(3eddf9a2){key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1, isCreated=true, isChanged=true, isRemoved=false, isValid=true, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=null}} 11:35:52,907 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeB-p427-t4) Trying to commit. Key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. Operation Flag=PUT_FOR_STATE_TRANSFER, L1 invalidation=false 11:35:52,907 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-threadNodeB-p427-t4) Creating new ICE for writing. Existing=null, metadata=EmbeddedMetadata{version=null}, new value=v1 11:35:52,907 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (Incoming-1,NodeA-45995) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} [sender=NodeD-43076] 11:35:52,907 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-threadNodeB-p427-t4) Store ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} in container 11:35:52,907 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (Incoming-1,NodeA-45995) Calling perform() on StateRequestCommand{cache=dist, origin=NodeD-43076, type=CANCEL_STATE_TRANSFER, topologyId=9, segments=[64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126]} 11:35:52,907 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeB-p427-t4) Committed key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 11:35:52,907 TRACE [org.infinispan.statetransfer.StateProviderImpl] (Incoming-1,NodeA-45995) Cancelling outbound transfer of segments [64, 65, 130, 67, 131, 68, 69, 70, 73, 74, 12, 207, 208, 209, 210, 84, 85, 213, 214, 151, 215, 152, 216, 89, 153, 90, 94, 174, 175, 117, 118, 119, 187, 61, 62, 126] to node NodeD-43076 with topology id 9 for cache dist 11:35:52,908 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-threadNodeB-p427-t4) Release locks for keys=[]. owner=GlobalTx:NodeB-51742:28 11:35:52,908 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-threadNodeB-p427-t4) Clearing locked keys: [] 11:35:52,908 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeB-p427-t4) Changing minimum topology ID from 9 to 10 11:35:52,908 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeB-p427-t4) Removed LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=9, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.synchronization.SyncLocalTransaction@1c from transaction table. 11:35:52,908 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-threadNodeB-p427-t4) Transaction GlobalTx:NodeB-51742:28 has completed, notifying listening threads. 11:35:52,908 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-threadNodeB-p427-t4) Committed in onePhase? false isOptimistic? true 11:35:52,908 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished applying chunk of segment 194 of cache dist 11:35:52,908 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeB-p427-t4) Finished receiving state for segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] of cache dist 11:35:52,908 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Inbound transfer finished: InboundTransferTask{segments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253], finishedSegments=[194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253], unfinishedSegments=[], source=NodeA-45995, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7047aa14[Completed normally], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,908 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Removing inbound transfers for segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] from source NodeA-45995 for cache dist 11:35:52,908 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Finished receiving of segments for cache dist for topology 10. 11:35:52,908 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeB-p427-t4) Stop keeping track of changed keys for state transfer 11:35:52,908 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeB-p427-t4) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,908 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeB-p427-t4) Tracking is disabled. Clear tracker: {MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}} 11:35:52,908 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeB-p427-t4) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=0 11:35:52,908 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeB-p427-t4) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} to single recipient NodeA-45995 with response mode GET_NONE 11:35:52,908 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeB-p427-t4) NodeB-51742 --> DATA(NodeA-45995: #27, conn_id=0) 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute invalidations [r=true,w=false,is=false,type=long] 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStaleStatsTreshold 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute commits [r=true,w=false,is=false,type=long] 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute prepares [r=true,w=false,is=false,type=long] 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rollbacks [r=true,w=false,is=false,type=long] 11:35:52,906 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 156 of cache dist 11:35:52,908 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 227 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 227 of cache dist 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 36 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 36 of cache dist 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 228 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 225 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 225 of cache dist 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 97 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 97 of cache dist 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 98 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 98 of cache dist 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 96 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 96 of cache dist 11:35:52,909 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 228 of cache dist 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 232 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 232 of cache dist 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 234 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 234 of cache dist 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 231 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 231 of cache dist 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 230 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 230 of cache dist 11:35:52,908 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 102 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,908 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeB-p427-t4) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 11:35:52,912 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,912 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (119 bytes) 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 102 of cache dist 11:35:52,912 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) After applying the received state the data container of cache dist has 3 keys 11:35:52,912 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeB-p415-t5) Segments not received yet for cache dist: {} 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationFailures [r=true,w=false,is=false,type=long] 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute replicationCount [r=true,w=false,is=false,type=long] 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 11:35:52,912 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 11:35:52,912 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 101 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,912 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #27, conn_id=0) 11:35:52,912 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#27 11:35:52,911 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 235 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,912 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,912 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=10, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} [sender=NodeB-51742] 11:35:52,912 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,912 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) ISPN000328: Finished local rebalance for cache dist on node NodeB-51742, topology id = 10 11:35:52,912 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t5) [Context=dist][Scope=NodeB-51742]ISPN100003: Finished local rebalance 11:35:52,912 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t5) Rebalance confirmation collector 9@dist received confirmation for NodeB-51742, remaining list is [NodeA-45995] 11:35:52,912 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 235 of cache dist 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 178 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 178 of cache dist 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 181 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 181 of cache dist 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 188 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 188 of cache dist 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 177 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 189 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 177 of cache dist 11:35:52,912 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 11:35:52,912 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=194, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} 11:35:52,917 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1119 to NodeA-45995 11:35:52,917 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeA-45995: #28, conn_id=0) 11:35:52,917 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1119, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void setStatisticsEnabled 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void disconnectSource 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation long synchronizeData 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void recordKnownGlobalKeyset 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:52,917 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,917 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (78 bytes) 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute passivations [r=true,w=false,is=false,type=long] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 11:35:52,917 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 237 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,917 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 101 of cache dist 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 189 of cache dist 11:35:52,918 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 127 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,918 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 127 of cache dist 11:35:52,914 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 176 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,918 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 176 of cache dist 11:35:52,917 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1119, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 11:35:52,917 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 237 of cache dist 11:35:52,917 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:52,919 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute elapsedTime [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void resetStatistics 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictionSize [r=true,w=true,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isAffectedByRehash 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.util.List locateKey 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation boolean isLocatedLocally 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Transactions 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RpcManager 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=LockManager 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Activation 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Passivation 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Statistics 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=Configuration 11:35:52,920 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=Cache,name="dist(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 11:35:52,920 DEBUG [org.infinispan.transaction.impl.TransactionTable] (testng) Wait for on-going transactions to finish for 0 milliseconds. 11:35:52,920 DEBUG [org.infinispan.transaction.impl.TransactionTable] (testng) All transactions terminated 11:35:52,920 TRACE [org.infinispan.container.DefaultDataContainer] (testng) Clearing data container 11:35:52,920 DEBUG [org.infinispan.xsite.BackupReceiverRepositoryImpl] (testng) Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'dist' 11:35:52,920 DEBUG [org.infinispan.manager.DefaultCacheManager] (testng) Stopping cache manager ISPN on NodeD-43076 11:35:52,920 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Cache stop order: [dist] 11:35:52,920 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Ignoring cache dist, it is already terminated. 11:35:52,920 TRACE [org.infinispan.jmx.ComponentsJmxRegistration] (testng) Unregistering jmx resources.. 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterAvailability [r=true,w=false,is=false,type=java.lang.String] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String cancelPushState 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String bringSiteOnline 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String takeSiteOffline 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String pushState 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute physicalAddresses [r=true,w=false,is=false,type=java.lang.String] 11:35:52,920 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute nodeAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:52,919 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #28, conn_id=0) 11:35:52,921 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t2) Finished receiving state for segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] of cache dist 11:35:52,921 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#28 11:35:52,921 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeA-45995) Responses: sender=NodeB-51742, received=true, suspected=false 11:35:52,921 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Inbound transfer finished: InboundTransferTask{segments=[199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127], finishedSegments=[199, 75, 205, 141, 14, 82, 154, 155, 91, 92, 156, 96, 225, 97, 98, 227, 36, 228, 101, 230, 102, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127], unfinishedSegments=[], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3ed5519[Completed normally], topologyId=9, timeout=240000, cacheName=dist} 11:35:52,921 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Removing inbound transfers for segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] from source NodeB-51742 for cache dist 11:35:52,921 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeA-45995) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=194, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=NodeA-45995, topologyId=9} is {NodeB-51742=SuccessfulResponse{responseValue=null} } 11:35:52,921 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeA-p408-t3) Outbound transfer of segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] of cache dist to node NodeB-51742 is complete 11:35:52,924 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeB-51742) NodeB-51742 --> ACK(NodeD-43076: #9) 11:35:52,924 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeB-51742) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are UNICAST3: ACK, seqno=9, conn_id=2, ts=5, TP: [cluster_name=ISPN] 11:35:52,924 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t4) Requesting segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist from node NodeB-51742 11:35:52,923 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeA-p408-t3) Removing completed outbound transfer of segments [194, 196, 133, 134, 7, 9, 10, 143, 144, 149, 219, 220, 221, 31, 159, 160, 161, 163, 43, 107, 108, 172, 109, 46, 47, 48, 50, 242, 243, 244, 245, 56, 248, 57, 58, 59, 253] to NodeB-51742 for cache dist 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (63 bytes) 11:35:52,921 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) After applying the received state the data container of cache dist has 4 keys 11:35:52,925 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Segments not received yet for cache dist: {NodeB-51742=[InboundTransferTask{segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], finishedSegments=[], unfinishedSegments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3d90d1c2[Not completed], topologyId=10, timeout=240000, cacheName=dist}]} 11:35:52,925 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=9} 11:35:52,925 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 1128 to NodeB-51742 11:35:52,925 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #21, conn_id=1) 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1128, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (78 bytes) 11:35:52,925 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute runningCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:52,925 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinatorAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:52,925 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:52,925 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheConfigurationNames [r=true,w=false,is=false,type=java.lang.String] 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=9, conn_id=2, ts=5, TP: [cluster_name=ISPN] 11:35:52,925 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeD-43076) NodeD-43076 <-- ACK(NodeB-51742: #9, conn-id=2, ts=5) 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1128, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,925 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeB-51742) NodeB-51742 --> ACK(NodeA-45995: #20) 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are UNICAST3: ACK, seqno=20, conn_id=1, ts=6, TP: [cluster_name=ISPN] 11:35:52,925 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeB-51742) NodeB-51742 --> ACK(NodeC-21874: #6) 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeB-51742) NodeB-51742: sending msg to NodeC-21874, src=NodeB-51742, headers are UNICAST3: ACK, seqno=6, conn_id=1, ts=7, TP: [cluster_name=ISPN] 11:35:52,925 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995 invoking StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to recipient list [NodeB-51742] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 11:35:52,925 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-threadNodeA-p411-t4) dests=[NodeB-51742], command=StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 11:35:52,928 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (stateTransferExecutor-threadNodeA-p411-t4) Replication task sending StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} to addresses [NodeB-51742] with response mode GET_ALL 11:35:52,928 TRACE [org.jgroups.blocks.RequestCorrelator] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995: invoking multicast RPC [req-id=1141] 11:35:52,928 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995 --> DATA(NodeB-51742: #22, conn_id=1) 11:35:52,928 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-threadNodeA-p411-t4) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1141, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,928 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (181 bytes (905.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,928 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (184 bytes) 11:35:52,929 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=108 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1141, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,929 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #22, conn_id=1) 11:35:52,929 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#22 11:35:52,929 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1141 11:35:52,929 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} [sender=NodeA-45995] 11:35:52,929 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,929 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeB-p415-t5) Calling perform() on StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,929 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Starting outbound transfer of segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] to node NodeA-45995 with topology id 10 for cache dist 11:35:52,929 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-threadNodeB-p415-t5) Adding outbound transfer of segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] to NodeA-45995 11:35:52,929 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=null} for command StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} 11:35:52,929 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1141 to NodeA-45995 11:35:52,929 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeA-45995: #29, conn_id=0) 11:35:52,929 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1141, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 11:35:52,929 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t5) Sending last chunk containing 0 cache entries from segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist to node NodeA-45995 11:35:52,925 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,925 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #21, conn_id=1) 11:35:52,925 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterMembers [r=true,w=false,is=false,type=java.lang.String] 11:35:52,936 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterName [r=true,w=false,is=false,type=java.lang.String] 11:35:52,933 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (63 bytes) 11:35:52,936 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 2 msgs (137 bytes (685.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeA-45995] 11:35:52,936 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8302 (63 bytes) 11:35:52,936 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-threadNodeB-p417-t5) NodeB-51742 invoking StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=10} to recipient list [NodeA-45995] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 11:35:52,936 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t5) dests=[NodeA-45995], command=StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=10}, mode=SYNCHRONOUS, timeout=240000 11:35:52,936 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t5) Replication task sending StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=10} to single recipient NodeA-45995 with response mode GET_ALL 11:35:52,937 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeB-p417-t5) NodeB-51742: invoking unicast RPC [req-id=1146] on NodeA-45995 11:35:52,943 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t5) NodeB-51742 --> DATA(NodeA-45995: #30, conn_id=0) 11:35:52,943 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1146, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 11:35:52,943 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=6, conn_id=1, ts=7, TP: [cluster_name=ISPN] 11:35:52,943 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeC-21874) NodeC-21874 <-- ACK(NodeB-51742: #6, conn-id=1, ts=7) 11:35:52,943 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=20, conn_id=1, ts=6, TP: [cluster_name=ISPN] 11:35:52,936 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (80 bytes) 11:35:52,953 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=4 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1141, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 11:35:52,936 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#21 11:35:52,953 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #29, conn_id=0) 11:35:52,953 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer-2,NodeA-45995) NodeA-45995: sending stable msg to NodeA-45995: NodeA-45995: [14], NodeB-51742: [0], NodeC-21874: [0], NodeD-43076: [0] 11:35:52,936 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute name [r=true,w=false,is=false,type=java.lang.String] 11:35:52,953 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeA-45995) NodeA-45995: sending msg to NodeA-45995, src=NodeA-45995, headers are STABLE: [STABLE_GOSSIP] view-id= [NodeA-45995|3], TP: [cluster_name=ISPN] 11:35:52,953 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#29 11:35:52,954 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeA-45995) Responses: Responses{ NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=null} , received=true, suspected=false} 11:35:52,954 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeA-45995) Response(s) to StateRequestCommand{cache=dist, origin=NodeA-45995, type=START_STATE_TRANSFER, topologyId=10, segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250]} is {NodeB-51742=SuccessfulResponse{responseValue=null} } 11:35:52,954 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t4) Successfully requested segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist from node NodeB-51742 11:35:52,954 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995, received=true, suspected=false 11:35:52,954 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], finishedSegments=[], unfinishedSegments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3d90d1c2[Not completed], topologyId=10, timeout=240000, cacheName=dist} 11:35:52,945 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (222 bytes (1110.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,954 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (225 bytes) 11:35:52,945 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- ACK(NodeB-51742: #20, conn-id=1, ts=6) 11:35:52,954 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=149 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1146, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 11:35:52,955 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #30, conn_id=0) 11:35:52,955 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#30 11:35:52,955 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1146 11:35:52,955 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=10} [sender=NodeB-51742] 11:35:52,955 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (OOB-1,NodeA-45995) Checking if transaction data was received for topology 0, current topology is 10 11:35:52,955 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:52,955 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-threadNodeA-p406-t6) Calling perform() on StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=10} 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Before applying the received state the data container of cache dist has 4 keys 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 229 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 226 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 229 of cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 226 of cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 233 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 100 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 233 of cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 100 of cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 51 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 51 of cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 236 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 236 of cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 179 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 179 of cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 35 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 35 of cache dist 11:35:52,954 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeB-51742) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=9} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,955 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t4) Outbound transfer of segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] of cache dist to node NodeA-45995 is complete 11:35:52,953 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterSize [r=true,w=false,is=false,type=int] 11:35:52,953 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeA-45995) NodeA-45995: looping back message [dst: NodeA-45995, src: NodeA-45995 (2 headers), size=77 bytes, flags=OOB|NO_RELIABILITY|INTERNAL] 11:35:52,956 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute globalConfigurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:52,956 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinator [r=true,w=false,is=true,type=boolean] 11:35:52,956 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:52,956 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeA-45995 (2 headers), size=77 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [NodeA-45995|3], TP: [cluster_name=ISPN] 11:35:52,956 TRACE [org.jgroups.protocols.pbcast.STABLE] (INT-2,NodeA-45995) NodeA-45995: handling digest from NodeA-45995: mine: NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1], NodeD-43076: [-1] other: NodeA-45995: [14], NodeB-51742: [0], NodeC-21874: [0], NodeD-43076: [0] result: NodeA-45995: [14], NodeB-51742: [0], NodeC-21874: [0], NodeD-43076: [0] 11:35:52,955 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeB-p417-t4) Removing completed outbound transfer of segments [199, 75, 141, 205, 14, 82, 154, 91, 155, 92, 156, 96, 97, 225, 98, 227, 36, 228, 101, 102, 230, 231, 232, 234, 235, 237, 176, 177, 178, 181, 188, 189, 127] to NodeA-45995 for cache dist 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Applying new state chunk for segment 52 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,955 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 164 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,956 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 164 of cache dist 11:35:52,956 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Finished applying chunk of segment 52 of cache dist 11:35:52,959 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Applying new state chunk for segment 180 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,959 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Applying new state chunk for segment 250 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,959 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t4) Finished applying chunk of segment 250 of cache dist 11:35:52,959 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Applying new state chunk for segment 249 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,960 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t3) Finished applying chunk of segment 249 of cache dist 11:35:52,956 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute createdCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:52,960 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheManagerStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:52,960 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Applying new state chunk for segment 53 of cache dist from node NodeB-51742: received 0 cache entries 11:35:52,960 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheNames [r=true,w=false,is=false,type=java.lang.String] 11:35:52,960 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t2) Finished applying chunk of segment 53 of cache dist 11:35:52,960 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:52,960 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:52,959 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished applying chunk of segment 180 of cache dist 11:35:52,961 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-threadNodeA-p411-t1) Finished receiving state for segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist 11:35:52,963 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Inbound transfer finished: InboundTransferTask{segments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], finishedSegments=[226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250], unfinishedSegments=[], source=NodeB-51742, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3d90d1c2[Completed normally], topologyId=10, timeout=240000, cacheName=dist} 11:35:52,963 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Removing inbound transfers for segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] from source NodeB-51742 for cache dist 11:35:52,963 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Finished receiving of segments for cache dist for topology 10. 11:35:52,960 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=LocalTopologyManager 11:35:52,972 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=GlobalXSiteAdminOperations 11:35:52,972 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=CacheContainerStats 11:35:52,972 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-f748d646-6fd1-4fbe-be6d-e9a7085dd775:type=CacheManager,name="DefaultCacheManager",component=CacheManager 11:35:52,972 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Stopping LocalTopologyManager on NodeD-43076 11:35:52,963 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-threadNodeA-p411-t1) Stop keeping track of changed keys for state transfer 11:35:52,972 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeA-p411-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,972 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000080: Disconnecting JGroups channel ISPN 11:35:52,972 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-threadNodeA-p411-t1) Tracking is disabled. Clear tracker: {MagicKey#k3{1A/92BE3B55/33@NodeC-21874}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}} 11:35:52,972 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeA-45995, joinInfo=null, topologyId=10, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} 11:35:52,972 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) After applying the received state the data container of cache dist has 4 keys 11:35:52,972 DEBUG [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t1) ISPN000328: Finished local rebalance for cache dist on node NodeA-45995, topology id = 10 11:35:52,972 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-threadNodeA-p406-t6) Segments not received yet for cache dist: {} 11:35:52,976 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) About to send back response null for command StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=10} 11:35:52,976 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeA-p406-t6) sending rsp for 1146 to NodeB-51742 11:35:52,976 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t1) [Context=dist][Scope=NodeA-45995]ISPN100003: Finished local rebalance 11:35:52,976 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #23, conn_id=1) 11:35:52,976 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-threadNodeA-p408-t1) Rebalance confirmation collector 9@dist received confirmation for NodeA-45995, remaining list is [] 11:35:52,976 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1146, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,976 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t1) ISPN000336: Finished cluster-wide rebalance for cache dist, topology id = 10 11:35:52,976 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t1) Cache dist topology updated: CacheTopology{id=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, members = [NodeA-45995, NodeB-51742], joiners = [] 11:35:52,976 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (75 bytes (375.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:52,976 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (78 bytes) 11:35:52,976 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=2 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1146, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 11:35:52,976 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #23, conn_id=1) 11:35:52,976 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#23 11:35:52,976 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-1,NodeB-51742) Responses: sender=NodeA-45995, received=true, suspected=false 11:35:52,976 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (OOB-1,NodeB-51742) Response(s) to StateResponseCommand{cache=dist, stateChunks=[StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=NodeB-51742, topologyId=10} is {NodeA-45995=SuccessfulResponse{responseValue=null} } 11:35:52,976 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-threadNodeB-p417-t5) Outbound transfer of segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] of cache dist to node NodeA-45995 is complete 11:35:52,976 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeD-43076: sending LEAVE request to NodeA-45995 11:35:52,976 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> DATA(NodeA-45995: #25, conn_id=0) 11:35:52,976 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-threadNodeB-p417-t5) Removing completed outbound transfer of segments [226, 35, 100, 164, 229, 233, 236, 51, 179, 52, 180, 53, 249, 250] to NodeA-45995 for cache dist 11:35:52,976 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,977 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Updating cluster-wide current topology for cache dist, topology = CacheTopology{id=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, availability mode = AVAILABLE 11:35:52,980 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:52,980 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} 11:35:52,980 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t2) Waiting on view 3 being accepted 11:35:52,980 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t2) Updating local topology for cache dist: CacheTopology{id=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,980 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t2) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,980 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t2) Installing new cache topology CacheTopology{id=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:52,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=11, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,980 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t2) Signalling topology 11 is installed 11:35:52,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:52,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) On cache dist we have: added segments: []; removed segments: [] 11:35:52,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Topology update processed, stateTransferTopologyId = 9, startRebalance = false, pending CH = null 11:35:52,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Stop keeping track of changed keys for state transfer 11:35:52,980 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t2) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,980 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t2) Tracking is disabled. Clear tracker: {} 11:35:52,980 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t2) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]} with new topology 11 and was pre false 11:35:52,980 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t2) No change listeners present! 11:35:52,980 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Unlock State Transfer in Progress for topology ID 11 11:35:52,980 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t2) Signalling transaction data received for topology 11 11:35:52,980 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,977 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are GMS: GmsHeader[LEAVE_REQ]: mbr=NodeD-43076, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 11:35:52,981 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:52,981 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (86 bytes) 11:35:52,981 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeD-43076 (3 headers), size=0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=NodeD-43076, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 11:35:52,981 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeD-43076: #25, conn_id=0) 11:35:52,981 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeD-43076#25 11:35:52,981 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: joiners=[], suspected=[], leaving=[NodeD-43076], new view: [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:52,981 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: sending LEAVE response to NodeD-43076 11:35:52,980 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,984 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t2) Removing no longer owned entries for cache dist 11:35:52,985 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) Topology changed, recalculating minTopologyId 11:35:52,985 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t2) Changing minimum topology ID from 10 to 11 11:35:52,980 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t1) Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:52,987 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-threadNodeA-p408-t1) NodeA-45995: sending NodeA-45995#15 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t1) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 11:35:52,987 TRACE [org.jgroups.protocols.MFC] (transport-threadNodeA-p408-t1) NodeA-45995 used 3268 credits, 1945927 remaining 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (3319 bytes (16595.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:52,987 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t1) Rebalancing consistent hash for cache dist, members are [NodeA-45995, NodeB-51742] 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (3322 bytes) 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (3322 bytes) 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (3322 bytes) 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=3268 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 11:35:52,987 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: received NodeA-45995#15 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=3268 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 11:35:52,987 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#15 11:35:52,987 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#15 11:35:52,987 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,987 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#15 11:35:52,987 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,987 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,987 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,987 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeD-43076) NodeA-45995 used 3268 credits, 1962134 remaining 11:35:52,987 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,987 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:52,987 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 3268 credits, 1945927 remaining 11:35:52,987 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-threadNodeC-p458-t6) Ignoring consistent hash update 11 for cache dist that doesn't exist locally 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster_name=ISPN] 11:35:52,988 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (57 bytes (285.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:52,988 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (60 bytes) 11:35:52,987 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t1) Updating cache dist topology for rebalance: CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,987 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=3268 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 11:35:52,988 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: received NodeA-45995#15 11:35:52,988 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t1) Cache dist topology updated: CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, members = [NodeA-45995, NodeB-51742], joiners = [] 11:35:52,988 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,988 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:52,988 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-threadNodeA-p408-t1) Initialized rebalance confirmation collector 12@dist, initial list is [NodeA-45995, NodeB-51742] 11:35:52,988 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t1) ISPN000310: Starting cluster-wide rebalance for cache dist, topology CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,988 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t1) [Context=dist][Scope=NodeA-45995]ISPN100002: Started local rebalance 11:35:52,988 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) dests=null, command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3}, mode=ASYNCHRONOUS, timeout=240000 11:35:52,988 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t1) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} to addresses null with response mode GET_NONE 11:35:52,988 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} 11:35:52,988 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-threadNodeA-p408-t1) NodeA-45995: sending NodeA-45995#16 11:35:52,988 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t5) Waiting on view 3 being accepted 11:35:52,988 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t1) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 11:35:52,988 TRACE [org.jgroups.protocols.MFC] (transport-threadNodeA-p408-t1) NodeA-45995 used 6406 credits, 1939521 remaining 11:35:52,988 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t5) Updating local topology for cache dist: CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,988 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t5) Starting local rebalance for cache dist, topology = CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,988 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t5) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:52,988 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t5) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:52,988 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t5) Installing new cache topology CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:52,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=12, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:52,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Start keeping track of keys for rebalance 11:35:52,989 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t5) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,989 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t5) Tracking is disabled. Clear tracker: {} 11:35:52,989 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t5) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:52,989 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t5) Signalling topology 12 is installed 11:35:52,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:52,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) On cache dist we have: added segments: []; removed segments: [] 11:35:52,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Topology update processed, stateTransferTopologyId = 12, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} 11:35:52,989 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t5) Signalling transaction data received for topology 12 11:35:52,989 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Finished receiving of segments for cache dist for topology 12. 11:35:52,989 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Stop keeping track of changed keys for state transfer 11:35:52,989 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t5) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:52,989 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t5) Tracking is disabled. Clear tracker: {} 11:35:52,989 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], remote transactions: 0 11:35:52,989 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) No remote transactions pertain to originator(s) who have left the cluster. 11:35:52,989 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t5) Removing no longer owned entries for cache dist 11:35:52,989 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) Topology changed, recalculating minTopologyId 11:35:52,989 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t5) Changing minimum topology ID from 11 to 12 11:35:52,989 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=3} 11:35:52,989 DEBUG [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t5) ISPN000328: Finished local rebalance for cache dist on node NodeA-45995, topology id = 12 11:35:52,989 INFO [org.infinispan.CLUSTER] (transport-threadNodeA-p408-t5) [Context=dist][Scope=NodeA-45995]ISPN100003: Finished local rebalance 11:35:52,989 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-threadNodeA-p408-t5) Rebalance confirmation collector 12@dist received confirmation for NodeA-45995, remaining list is [NodeB-51742] 11:35:52,991 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (6457 bytes (32285.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:52,991 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (6460 bytes) 11:35:52,991 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (6460 bytes) 11:35:52,991 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (6460 bytes) 11:35:52,992 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeD-43076) NodeD-43076: received [dst: , src: NodeA-45995 (3 headers), size=6406 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 11:35:52,992 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: received NodeA-45995#16 11:35:52,992 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-2,NodeD-43076) NodeD-43076: delivering NodeA-45995#16 11:35:52,992 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-2,NodeD-43076) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,992 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-2,NodeD-43076) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,992 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-2,NodeD-43076) Added a new task directly: 0 task(s) are waiting 11:35:52,992 TRACE [org.jgroups.protocols.MFC] (OOB-2,NodeD-43076) NodeA-45995 used 6406 credits, 1955728 remaining 11:35:52,992 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=6406 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 11:35:52,992 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: received NodeA-45995#16 11:35:52,992 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#16 11:35:52,992 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,992 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,992 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:52,992 TRACE [org.jgroups.protocols.MFC] (OOB-3,NodeB-51742) NodeA-45995 used 6406 credits, 1942789 remaining 11:35:52,988 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeD-43076) NodeD-43076: received [dst: NodeD-43076, src: NodeA-45995 (2 headers), size=0 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster_name=ISPN] 11:35:52,993 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeD-43076: got LEAVE response from NodeA-45995 11:35:52,994 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [null],NodeA-45995) 127.0.0.1:8300: removed connection to 127.0.0.1:8303 11:35:52,994 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [null],NodeC-21874) 127.0.0.1:8302: removed connection to 127.0.0.1:8303 11:35:52,994 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [null],NodeB-51742) 127.0.0.1:8301: removed connection to 127.0.0.1:8303 11:35:52,987 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: mcasting view [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] (3 mbrs) 11:35:53,002 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (ViewHandler,NodeA-45995) NodeA-45995: sending NodeA-45995#17 11:35:53,001 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=6406 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 11:35:53,002 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#16 11:35:53,002 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#16 11:35:53,002 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:53,002 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:52,999 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> ACK(NodeA-45995: #21) 11:35:52,993 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#15 11:35:53,003 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:52,992 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t6) Waiting on view 3 being accepted 11:35:53,003 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} [sender=NodeA-45995] 11:35:53,003 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:53,003 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeB-51742) NodeA-45995 used 3268 credits, 1939521 remaining 11:35:53,003 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t6) Updating local topology for cache dist: CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,002 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-threadNodeC-p458-t6) Ignoring rebalance 12 for cache dist that doesn't exist locally 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeA-45995, src=NodeD-43076, headers are UNICAST3: ACK, seqno=21, conn_id=3, ts=7, TP: [cluster_name=ISPN] 11:35:53,002 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:53,015 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t6) Starting local rebalance for cache dist, topology = CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,015 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 6406 credits, 1939521 remaining 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8300 (63 bytes) 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) 127.0.0.1:8303: server is not running, discarding message to 127.0.0.1:8300 11:35:53,002 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to null, src=NodeA-45995, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: looping back message [dst: , src: NodeA-45995 (3 headers), size=61 bytes] 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (112 bytes (560.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (115 bytes) 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (115 bytes) 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 11:35:53,015 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: received NodeA-45995#17 11:35:53,015 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: delivering NodeA-45995#17-17 (1 messages) 11:35:53,015 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: received delta view [NodeA-45995|4], ref-view=[NodeA-45995|3], left=[NodeD-43076] 11:35:53,015 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: installing view [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,016 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995: closing connections of non members [NodeD-43076] 11:35:53,016 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: removed NodeD-43076 from xmit_table (not member anymore) 11:35:53,015 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t6) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 1 0, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 1 0, 15: 1 0, 16: 1 0, 17: 1 0, 18: 1 0, 19: 1 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 0 1, 39: 0 1, 40: 1 0, 41: 1 0, 42: 0 1, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 0 1, 50: 0 1, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 0 1, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 0 1, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 0 1, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 0 1, 106: 0 1, 107: 0 1, 108: 0 1, 109: 0 1, 110: 0 1, 111: 0 1, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 0 1, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 1 0, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 1 0, 140: 1 0, 141: 1 0, 142: 1 0, 143: 1 0, 144: 0 1, 145: 1 0, 146: 1 0, 147: 1 0, 148: 0 1, 149: 0 1, 150: 1 0, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 1 0, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 1 0, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 1 0, 180: 1 0, 181: 1 0, 182: 1 0, 183: 1 0, 184: 1 0, 185: 1 0, 186: 0 1, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 1 0, 192: 1 0, 193: 1 0, 194: 0 1, 195: 0 1, 196: 0 1, 197: 0 1, 198: 1 0, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 0 1, 207: 0 1, 208: 0 1, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 0 1, 214: 0 1, 215: 0 1, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 0 1, 224: 0 1, 225: 1 0, 226: 1 0, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 1 0, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 0 1, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 0 1, 248: 0 1, 249: 1 0, 250: 1 0, 251: 1 0, 252: 1 0, 253: 0 1, 254: 0 1, 255: 0 1 11:35:53,016 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1] 11:35:53,016 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t6) Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:53,015 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> ACK(NodeC-21874: #8) 11:35:53,016 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeC-21874, src=NodeD-43076, headers are UNICAST3: ACK, seqno=8, conn_id=2, ts=8, TP: [cluster_name=ISPN] 11:35:53,016 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:53,016 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t6) Installing fake cache topology CacheTopology{id=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} for cache dist 11:35:53,016 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t6) Installing new cache topology CacheTopology{id=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:53,016 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=11, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,016 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t6) Signalling topology 11 is installed 11:35:53,016 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:53,016 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) On cache dist we have: added segments: []; removed segments: [] 11:35:53,016 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Topology update processed, stateTransferTopologyId = 9, startRebalance = false, pending CH = null 11:35:53,017 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Stop keeping track of changed keys for state transfer 11:35:53,016 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8302 (63 bytes) 11:35:53,017 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) 127.0.0.1:8303: server is not running, discarding message to 127.0.0.1:8302 11:35:53,016 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeD-43076 --> ACK(NodeB-51742: #10) 11:35:53,017 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeD-43076: sending msg to NodeB-51742, src=NodeD-43076, headers are UNICAST3: ACK, seqno=10, conn_id=2, ts=9, TP: [cluster_name=ISPN] 11:35:53,017 DEBUG [org.infinispan.test.fwk.TEST_PING] (testng) Stop discovery for NodeD-43076 11:35:53,017 DEBUG [org.jgroups.protocols.TCP_NIO2] (testng) closing sockets and stopping threads 11:35:53,016 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeA-45995) Handle view [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,017 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) NodeD-43076: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 11:35:53,017 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: received NodeA-45995#17 11:35:53,015 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 11:35:53,017 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#17-17 (1 messages) 11:35:53,017 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: received NodeA-45995#17 11:35:53,017 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#17-17 (1 messages) 11:35:53,017 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeC-21874) NodeC-21874: received delta view [NodeA-45995|4], ref-view=[NodeA-45995|3], left=[NodeD-43076] 11:35:53,017 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: received delta view [NodeA-45995|4], ref-view=[NodeA-45995|3], left=[NodeD-43076] 11:35:53,017 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeC-21874) NodeC-21874: installing view [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,017 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: installing view [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,017 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeC-21874) NodeC-21874: closing connections of non members [NodeD-43076] 11:35:53,017 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeC-21874) NodeC-21874: removed NodeD-43076 from xmit_table (not member anymore) 11:35:53,017 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeC-21874) NodeC-21874: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1] 11:35:53,017 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeC-21874) Handle view [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,017 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeC-21874) new membership: [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,018 TRACE [org.jgroups.protocols.FRAG2] (Incoming-1,NodeC-21874) NodeC-21874: removed NodeD-43076 from fragmentation table 11:35:53,017 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742: closing connections of non members [NodeD-43076] 11:35:53,018 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: removed NodeD-43076 from xmit_table (not member anymore) 11:35:53,018 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeB-51742) NodeB-51742: reset digest to NodeA-45995: [-1], NodeB-51742: [-1], NodeC-21874: [-1] 11:35:53,018 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeB-51742) Handle view [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,018 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeB-51742) new membership: [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,018 TRACE [org.jgroups.protocols.FRAG2] (Incoming-1,NodeB-51742) NodeB-51742: removed NodeD-43076 from fragmentation table 11:35:53,018 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:53,018 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) New view accepted: [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,018 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) Joined: [], Left: [NodeD-43076] 11:35:53,018 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,018 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeB-51742) ISPN100001: Node NodeD-43076 left the cluster 11:35:53,018 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:53,018 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], localAddress=NodeB-51742, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125908496777216 11:35:53,018 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], localAddress=NodeB-51742, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125908496777216 11:35:53,018 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742 --> DATA(NodeA-45995: #31, conn_id=0) 11:35:53,018 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 11:35:53,019 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,019 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (70 bytes) 11:35:53,019 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 11:35:53,017 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) dest=127.0.0.1:8301 (63 bytes) 11:35:53,019 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeD-43076) 127.0.0.1:8303: server is not running, discarding message to 127.0.0.1:8301 11:35:53,019 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeA-45995) new membership: [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,019 TRACE [org.jgroups.protocols.FRAG2] (Incoming-1,NodeA-45995) NodeA-45995: removed NodeD-43076 from fragmentation table 11:35:53,017 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:53,020 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000082: Stopping the RpcDispatcher for channel ISPN 11:35:53,019 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:53,020 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) New view accepted: [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,020 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) Joined: [], Left: [NodeD-43076] 11:35:53,020 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,019 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #31, conn_id=0) 11:35:53,019 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeB-p417-t2) Received new cluster view: 4, isCoordinator = false, old status = REGULAR_MEMBER 11:35:53,018 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,018 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:53,024 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeC-21874) New view accepted: [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,024 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#31 11:35:53,024 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeA-45995) ISPN100001: Node NodeD-43076 left the cluster 11:35:53,019 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Tracking is disabled. Clear tracker: {} 11:35:53,024 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], localAddress=NodeA-45995, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125904201809920 11:35:53,025 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], localAddress=NodeA-45995, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125904201809920 11:35:53,025 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995 --> DATA(NodeA-45995: #4, conn_id=0) 11:35:53,025 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: sending msg to NodeA-45995, src=NodeA-45995, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:53,025 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: looping back message [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 11:35:53,025 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=4, TP: [cluster_name=ISPN] 11:35:53,025 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- DATA(NodeA-45995: #4, conn_id=0) 11:35:53,025 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995: delivering NodeA-45995#4 11:35:53,025 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t4) Received new cluster view: 4, isCoordinator = true, old status = COORDINATOR 11:35:53,025 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t4) Updating cluster members for all the caches. New list is [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,025 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t4) dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 11:35:53,025 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t4) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to addresses null with response mode GET_ALL 11:35:53,025 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:53,025 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,024 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeC-21874) Joined: [], Left: [NodeD-43076] 11:35:53,026 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeC-21874) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|4] (3) [NodeA-45995, NodeB-51742, NodeC-21874] 11:35:53,026 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeC-p460-t4) Received new cluster view: 4, isCoordinator = false, old status = REGULAR_MEMBER 11:35:53,026 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeC-21874) ISPN100001: Node NodeD-43076 left the cluster 11:35:53,026 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeC-21874) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], localAddress=NodeC-21874, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125912791744512 11:35:53,026 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeC-21874) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742, NodeC-21874], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874, NodeD-43076], localAddress=NodeC-21874, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125912791744512 11:35:53,027 DEBUG [org.infinispan.manager.DefaultCacheManager] (testng) Stopping cache manager ISPN on NodeC-21874 11:35:53,027 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Cache stop order: [dist] 11:35:53,027 TRACE [org.infinispan.manager.DefaultCacheManager] (testng) Ignoring cache dist, it is already terminated. 11:35:53,027 TRACE [org.infinispan.jmx.ComponentsJmxRegistration] (testng) Unregistering jmx resources.. 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String pushState 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String cancelPushState 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String takeSiteOffline 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation java.lang.String bringSiteOnline 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterAvailability [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute nodeAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute physicalAddresses [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinator [r=true,w=false,is=true,type=boolean] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute coordinatorAddress [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute createdCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterName [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute version [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute name [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheNames [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute runningCacheCount [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute cacheManagerStatus [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterSize [r=true,w=false,is=false,type=int] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute definedCacheConfigurationNames [r=true,w=false,is=false,type=java.lang.String] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute globalConfigurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute clusterMembers [r=true,w=false,is=false,type=java.lang.String] 11:35:53,025 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t4) NodeA-45995: invoking multicast RPC [req-id=1162] 11:35:53,030 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-threadNodeA-p408-t4) NodeA-45995: sending NodeA-45995#18 11:35:53,027 WARN [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (remote-threadNodeD-p530-t6) ISPN000071: Caught exception when handling command CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} org.infinispan.commons.CacheConfigurationException: Unable to configure component (type: class org.infinispan.topology.CacheTopologyControlCommand, instance CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=NodeA-45995, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3}) 11:35:53,030 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t4) NodeA-45995: sending msg to null, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1162, rsp_expected=true, NAKACK2: [MSG, seqno=18], TP: [cluster_name=ISPN] 11:35:53,030 TRACE [org.jgroups.protocols.MFC] (transport-threadNodeA-p408-t4) NodeA-45995 used 8 credits, 1939513 remaining 11:35:53,030 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (61 bytes (305.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:53,031 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (64 bytes) 11:35:53,027 WARN [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (remote-threadNodeD-p530-t5) ISPN000071: Caught exception when handling command CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3} org.infinispan.commons.CacheConfigurationException: Unable to configure component (type: class org.infinispan.topology.CacheTopologyControlCommand, instance CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=3}) 11:35:53,031 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1162, rsp_expected=true, NAKACK2: [MSG, seqno=18], TP: [cluster_name=ISPN] 11:35:53,031 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: received NodeA-45995#18 11:35:53,031 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#18 11:35:53,031 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1162 11:35:53,031 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:53,024 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t6) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 141+52, NodeB-51742: 115+62]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]} with new topology 11 and was pre false 11:35:53,031 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:53,031 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:53,033 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1162 to NodeA-45995 11:35:53,033 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeB-51742) NodeA-45995 used 8 credits, 1939513 remaining 11:35:53,031 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (64 bytes) 11:35:53,030 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:53,027 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeC-21874) NodeC-21874 --> DATA(NodeA-45995: #18, conn_id=0) 11:35:53,036 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeC-21874) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 11:35:53,036 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,036 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (70 bytes) 11:35:53,036 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Operation void startCache 11:35:53,036 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 11:35:53,036 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute evictions [r=true,w=false,is=false,type=long] 11:35:53,036 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #18, conn_id=0) 11:35:53,036 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 11:35:53,036 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeC-21874#18 11:35:53,036 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (3) from members for view [NodeA-45995|4] 11:35:53,033 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeC-21874) NodeC-21874: received [dst: , src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1162, rsp_expected=true, NAKACK2: [MSG, seqno=18], TP: [cluster_name=ISPN] 11:35:53,033 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeA-45995: #32, conn_id=0) 11:35:53,037 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1162, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 11:35:53,037 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,037 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (81 bytes) 11:35:53,037 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1162, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 11:35:53,037 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #32, conn_id=0) 11:35:53,037 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#32 11:35:53,033 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t6) No change listeners present! 11:35:53,037 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Unlock State Transfer in Progress for topology ID 11 11:35:53,037 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t6) Signalling transaction data received for topology 11 11:35:53,037 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: received NodeA-45995#18 11:35:53,036 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageReadTime [r=true,w=false,is=false,type=long] 11:35:53,038 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 11:35:53,038 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 11:35:53,038 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hits [r=true,w=false,is=false,type=long] 11:35:53,038 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 11:35:53,038 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (OOB-1,NodeC-21874) NodeC-21874: delivering NodeA-45995#18 11:35:53,038 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeC-21874) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1162 11:35:53,038 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeC-21874) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:53,038 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeC-21874) Added a new task directly: 0 task(s) are waiting 11:35:53,038 TRACE [org.jgroups.protocols.MFC] (OOB-1,NodeC-21874) NodeA-45995 used 8 credits, 1939513 remaining 11:35:53,038 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeC-p458-t6) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:53,038 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeC-p458-t6) sending rsp for 1162 to NodeA-45995 11:35:53,037 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742, NodeC-21874], remote transactions: 0 11:35:53,038 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,038 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Removing no longer owned entries for cache dist 11:35:53,038 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeC-p458-t6) NodeC-21874 --> DATA(NodeA-45995: #19, conn_id=0) 11:35:53,039 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeMisses [r=true,w=false,is=false,type=long] 11:35:53,039 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute removeHits [r=true,w=false,is=false,type=long] 11:35:53,039 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute misses [r=true,w=false,is=false,type=long] 11:35:53,039 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute hitRatio [r=true,w=false,is=false,type=double] 11:35:53,039 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 11:35:53,039 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute stores [r=true,w=false,is=false,type=long] 11:35:53,039 TRACE [org.infinispan.jmx.ResourceDMBean] (testng) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 11:35:53,039 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=GlobalXSiteAdminOperations 11:35:53,039 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=LocalTopologyManager 11:35:53,039 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=CacheManager 11:35:53,039 TRACE [org.infinispan.jmx.JmxUtil] (testng) Unregistered infinispan-fd8d409d-3883-4f54-ab98-a236c872672f:type=CacheManager,name="DefaultCacheManager",component=CacheContainerStats 11:35:53,039 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (testng) Stopping LocalTopologyManager on NodeC-21874 11:35:53,039 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000080: Disconnecting JGroups channel ISPN 11:35:53,042 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeC-21874: sending LEAVE request to NodeA-45995 11:35:53,042 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> DATA(NodeA-45995: #20, conn_id=0) 11:35:53,042 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are GMS: GmsHeader[LEAVE_REQ]: mbr=NodeC-21874, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 11:35:53,039 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Topology changed, recalculating minTopologyId 11:35:53,042 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Changing minimum topology ID from 10 to 11 11:35:53,042 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t6) Installing new cache topology CacheTopology{id=12, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:53,042 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Received new topology for cache dist, isRebalance = true, isMember = true, topology = CacheTopology{id=12, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,042 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeC-p458-t6) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1162, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 11:35:53,042 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Start keeping track of keys for rebalance 11:35:53,042 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:53,042 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Tracking is disabled. Clear tracker: {} 11:35:53,042 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Set track to PUT_FOR_STATE_TRANSFER = true 11:35:53,042 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t6) Signalling topology 12 is installed 11:35:53,042 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:53,042 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) On cache dist we have: added segments: []; removed segments: [] 11:35:53,042 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (83 bytes (415.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,043 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (86 bytes) 11:35:53,043 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,043 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeC-21874 (3 headers), size=0 bytes, flags=OOB], headers are GMS: GmsHeader[LEAVE_REQ]: mbr=NodeC-21874, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 11:35:53,043 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeC-21874: #20, conn_id=0) 11:35:53,043 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeC-21874#20 11:35:53,039 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer-3,NodeC-21874) NodeC-21874: sending stable msg to NodeA-45995: NodeA-45995: [18], NodeB-51742: [0], NodeC-21874: [0] 11:35:53,043 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: joiners=[], suspected=[], leaving=[NodeC-21874], new view: [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,043 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: sending LEAVE response to NodeC-21874 11:35:53,043 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeC-21874) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are STABLE: [STABLE_GOSSIP] view-id= [NodeA-45995|4], TP: [cluster_name=ISPN] 11:35:53,043 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster_name=ISPN] 11:35:53,049 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: mcasting view [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] (2 mbrs) 11:35:53,049 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (57 bytes (285.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeC-21874] 11:35:53,049 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (60 bytes) 11:35:53,049 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) 127.0.0.1:8300: connecting to 127.0.0.1:8302 11:35:53,049 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (ViewHandler,NodeA-45995) NodeA-45995: sending NodeA-45995#19 11:35:53,043 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (81 bytes) 11:35:53,049 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: sending msg to null, src=NodeA-45995, headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=19], TP: [cluster_name=ISPN] 11:35:53,049 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (137 bytes (685.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,049 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (140 bytes) 11:35:53,050 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [127.0.0.1:8300],NodeC-21874) 127.0.0.1:8302: removed connection to 127.0.0.1:8300 11:35:53,050 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeC-21874) NodeC-21874: received [dst: NodeC-21874, src: NodeA-45995 (2 headers), size=0 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are GMS: GmsHeader[LEAVE_RSP], TP: [cluster_name=ISPN] 11:35:53,050 TRACE [org.jgroups.protocols.pbcast.GMS] (testng) NodeC-21874: got LEAVE response from NodeA-45995 11:35:53,055 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> ACK(NodeD-43076: #8) 11:35:53,042 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Topology update processed, stateTransferTopologyId = 12, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeD-43076, src=NodeC-21874, headers are UNICAST3: ACK, seqno=8, conn_id=1, ts=8, TP: [cluster_name=ISPN] 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [null],NodeB-51742) 127.0.0.1:8301: removed connection to 127.0.0.1:8302 11:35:53,057 TRACE [org.jgroups.protocols.UNICAST3] (testng) NodeC-21874 --> ACK(NodeA-45995: #12) 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (testng) NodeC-21874: sending msg to NodeA-45995, src=NodeC-21874, headers are UNICAST3: ACK, seqno=12, conn_id=2, ts=9, TP: [cluster_name=ISPN] 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:53,057 DEBUG [org.infinispan.test.fwk.TEST_PING] (testng) Stop discovery for NodeC-21874 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8303 (63 bytes) 11:35:53,057 DEBUG [org.jgroups.protocols.TCP_NIO2] (testng) closing sockets and stopping threads 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) 127.0.0.1:8302: server is not running, discarding message to 127.0.0.1:8303 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) NodeC-21874: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) dest=127.0.0.1:8300 (63 bytes) 11:35:53,057 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeC-21874) 127.0.0.1:8302: server is not running, discarding message to 127.0.0.1:8300 11:35:53,053 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [127.0.0.1:8302],NodeA-45995) 127.0.0.1:8300: removed connection to 127.0.0.1:8302 11:35:53,049 TRACE [org.jgroups.protocols.TCP_NIO2] (ViewHandler,NodeA-45995) NodeA-45995: looping back message [dst: , src: NodeA-45995 (3 headers), size=61 bytes] 11:35:53,060 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (112 bytes (560.00% of max_bundle_size) to 1 dests(s): [ISPN] 11:35:53,060 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (115 bytes) 11:35:53,060 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (testng) ISPN000082: Stopping the RpcDispatcher for channel ISPN 11:35:53,060 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=19], TP: [cluster_name=ISPN] 11:35:53,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: received NodeA-45995#19 11:35:53,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#19-19 (1 messages) 11:35:53,060 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: received delta view [NodeA-45995|5], ref-view=[NodeA-45995|4], left=[NodeC-21874] 11:35:53,060 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeB-51742) NodeB-51742: installing view [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,060 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742: closing connections of non members [NodeD-43076, NodeC-21874] 11:35:53,062 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeB-51742) NodeB-51742: removed NodeC-21874 from xmit_table (not member anymore) 11:35:53,062 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeB-51742) NodeB-51742: reset digest to NodeA-45995: [-1], NodeB-51742: [-1] 11:35:53,063 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeB-51742) Handle view [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,063 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeB-51742) new membership: [NodeA-45995, NodeB-51742] 11:35:53,063 TRACE [org.jgroups.protocols.FRAG2] (Incoming-1,NodeB-51742) NodeB-51742: removed NodeC-21874 from fragmentation table 11:35:53,063 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:53,063 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) New view accepted: [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,063 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) Joined: [], Left: [NodeC-21874] 11:35:53,063 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeB-51742) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,063 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeB-p417-t1) Received new cluster view: 5, isCoordinator = false, old status = REGULAR_MEMBER 11:35:53,063 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeB-51742) ISPN100001: Node NodeC-21874 left the cluster 11:35:53,063 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:53,063 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeB-p416-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,063 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeB-51742, viewId=5, subgroupsMerged=null, mergeView=false} and result was 1407383473487872 11:35:53,063 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeB-51742) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeB-51742, viewId=5, subgroupsMerged=null, mergeView=false} and result was 1407383473487872 11:35:53,063 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeB-51742) NodeB-51742 --> DATA(NodeA-45995: #33, conn_id=0) 11:35:53,063 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 11:35:53,063 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (67 bytes (335.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,063 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (70 bytes) 11:35:53,060 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: received [dst: , src: NodeA-45995 (3 headers), size=61 bytes], headers are GMS: GmsHeader[VIEW], NAKACK2: [MSG, seqno=19], TP: [cluster_name=ISPN] 11:35:53,063 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: received NodeA-45995#19 11:35:53,063 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 11:35:53,063 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: delivering NodeA-45995#19-19 (1 messages) 11:35:53,063 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #33, conn_id=0) 11:35:53,063 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#33 11:35:53,063 TRACE [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: received delta view [NodeA-45995|5], ref-view=[NodeA-45995|4], left=[NodeC-21874] 11:35:53,063 DEBUG [org.jgroups.protocols.pbcast.GMS] (Incoming-1,NodeA-45995) NodeA-45995: installing view [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,063 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995: closing connections of non members [NodeD-43076, NodeC-21874] 11:35:53,063 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-1,NodeA-45995) NodeA-45995: removed NodeC-21874 from xmit_table (not member anymore) 11:35:53,064 TRACE [org.jgroups.protocols.pbcast.STABLE] (Incoming-1,NodeA-45995) NodeA-45995: reset digest to NodeA-45995: [-1], NodeB-51742: [-1] 11:35:53,064 TRACE [org.jgroups.protocols.tom.TOA] (Incoming-1,NodeA-45995) Handle view [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,064 TRACE [org.jgroups.protocols.MFC] (Incoming-1,NodeA-45995) new membership: [NodeA-45995, NodeB-51742] 11:35:53,064 TRACE [org.jgroups.protocols.FRAG2] (Incoming-1,NodeA-45995) NodeA-45995: removed NodeC-21874 from fragmentation table 11:35:53,064 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Incoming-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:53,064 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) New view accepted: [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,064 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t6) Responses: Responses{ NodeC-21874: sender=NodeC-21874, received=false, suspected=true NodeB-51742: sender=NodeB-51742value=SuccessfulResponse{responseValue=true} , received=true, suspected=false} 11:35:53,057 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t6) Signalling transaction data received for topology 12 11:35:53,067 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Finished receiving of segments for cache dist for topology 12. 11:35:53,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Stop keeping track of changed keys for state transfer 11:35:53,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:53,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t6) Tracking is disabled. Clear tracker: {} 11:35:53,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t6) dests=[NodeA-45995], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=5}, mode=ASYNCHRONOUS, timeout=0 11:35:53,067 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeB-p417-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=12, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=5} to single recipient NodeA-45995 with response mode GET_NONE 11:35:53,067 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeB-p417-t6) NodeB-51742 --> DATA(NodeA-45995: #34, conn_id=0) 11:35:53,067 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeB-p417-t6) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 11:35:53,067 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:53,067 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,067 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t6) Removing no longer owned entries for cache dist 11:35:53,067 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Topology changed, recalculating minTopologyId 11:35:53,067 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t6) Changing minimum topology ID from 11 to 12 11:35:53,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t6) Waiting on view 3 being accepted 11:35:53,067 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t6) Ignoring late consistent hash update for cache dist, current topology is 12: CacheTopology{id=11, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,066 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t4) Node NodeC-21874 left while updating cache members 11:35:53,064 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) Joined: [], Left: [NodeC-21874] 11:35:53,069 INFO [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-1,NodeA-45995) ISPN000094: Received new cluster view for channel ISPN: [NodeA-45995|5] (2) [NodeA-45995, NodeB-51742] 11:35:53,069 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t2) Received new cluster view: 5, isCoordinator = true, old status = COORDINATOR 11:35:53,069 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t2) Updating cluster members for all the caches. New list is [NodeA-45995, NodeB-51742] 11:35:53,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t2) dests=null, command=CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1}, mode=SYNCHRONOUS, timeout=240000 11:35:53,069 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (transport-threadNodeA-p408-t2) Replication task sending CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=NodeA-45995, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=-1} to single recipient NodeB-51742 with response mode GET_ALL 11:35:53,069 TRACE [org.jgroups.blocks.RequestCorrelator] (transport-threadNodeA-p408-t2) NodeA-45995: invoking unicast RPC [req-id=1172] on NodeB-51742 11:35:53,069 TRACE [org.jgroups.protocols.UNICAST3] (transport-threadNodeA-p408-t2) NodeA-45995 --> DATA(NodeB-51742: #24, conn_id=1) 11:35:53,067 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (116 bytes (580.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,070 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (119 bytes) 11:35:53,069 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-threadNodeA-p408-t2) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1172, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 11:35:53,069 INFO [org.infinispan.CLUSTER] (Incoming-1,NodeA-45995) ISPN100001: Node NodeC-21874 left the cluster 11:35:53,071 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:53,071 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-threadNodeA-p407-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,071 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeA-45995, viewId=5, subgroupsMerged=null, mergeView=false} and result was 1407379178520576 11:35:53,072 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (Incoming-1,NodeA-45995) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[NodeA-45995, NodeB-51742], oldMembers=[NodeA-45995, NodeB-51742, NodeC-21874], localAddress=NodeA-45995, viewId=5, subgroupsMerged=null, mergeView=false} and result was 1407379178520576 11:35:53,072 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (81 bytes (405.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:53,073 TRACE [org.jgroups.protocols.UNICAST3] (Incoming-1,NodeA-45995) NodeA-45995 --> DATA(NodeA-45995: #5, conn_id=0) 11:35:53,073 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: sending msg to NodeA-45995, src=NodeA-45995, headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:53,073 TRACE [org.jgroups.protocols.TCP_NIO2] (Incoming-1,NodeA-45995) NodeA-45995: looping back message [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL] 11:35:53,073 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeA-45995 (3 headers), size=0 bytes, flags=OOB|INTERNAL], headers are GMS: GmsHeader[VIEW_ACK], UNICAST3: DATA, seqno=5, TP: [cluster_name=ISPN] 11:35:53,073 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995 <-- DATA(NodeA-45995: #5, conn_id=0) 11:35:53,073 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeA-45995) NodeA-45995: delivering NodeA-45995#5 11:35:53,073 TRACE [org.jgroups.protocols.pbcast.GMS] (ViewHandler,NodeA-45995) NodeA-45995: got all ACKs (2) from members for view [NodeA-45995|5] 11:35:53,070 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=45 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 11:35:53,073 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #34, conn_id=0) 11:35:53,073 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (84 bytes) 11:35:53,074 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=8 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=1172, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 11:35:53,074 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #24, conn_id=1) 11:35:53,073 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeA-45995) NodeA-45995: delivering NodeB-51742#34 11:35:53,075 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeA-45995) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:53,075 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#24 11:35:53,076 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 1172 11:35:53,076 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} [sender=NodeA-45995] 11:35:53,076 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:53,076 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeB-p415-t5) About to send back response SuccessfulResponse{responseValue=true} for command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=0} 11:35:53,076 TRACE [org.jgroups.blocks.RequestCorrelator] (remote-threadNodeB-p415-t5) sending rsp for 1172 to NodeA-45995 11:35:53,076 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeB-p415-t5) NodeB-51742 --> DATA(NodeA-45995: #35, conn_id=0) 11:35:53,076 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeB-p415-t5) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1172, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 11:35:53,076 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (78 bytes (390.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,076 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (81 bytes) 11:35:53,076 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (3 headers), size=5 bytes, flags=OOB|DONT_BUNDLE|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=RSP, req_id=1172, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 11:35:53,075 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeA-45995) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=NodeB-51742, joinInfo=null, topologyId=12, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, actualMembers=null, throwable=null, viewId=5} [sender=NodeB-51742] 11:35:53,077 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeA-45995) Added a new task directly: 0 task(s) are waiting 11:35:53,077 DEBUG [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) ISPN000328: Finished local rebalance for cache dist on node NodeB-51742, topology id = 12 11:35:53,077 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) [Context=dist][Scope=NodeB-51742]ISPN100003: Finished local rebalance 11:35:53,079 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-threadNodeA-p406-t6) Rebalance confirmation collector 12@dist received confirmation for NodeB-51742, remaining list is [] 11:35:53,079 INFO [org.infinispan.CLUSTER] (remote-threadNodeA-p406-t6) ISPN000336: Finished cluster-wide rebalance for cache dist, topology id = 12 11:35:53,079 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Cache dist topology updated: CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, members = [NodeA-45995, NodeB-51742], joiners = [] 11:35:53,080 TRACE [org.infinispan.topology.CacheTopology] (remote-threadNodeA-p406-t6) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:53,080 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t6) Updating cluster-wide current topology for cache dist, topology = CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]}, availability mode = AVAILABLE 11:35:53,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t6) dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5}, mode=ASYNCHRONOUS, timeout=240000 11:35:53,080 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5} to single recipient NodeB-51742 with response mode GET_NONE 11:35:53,080 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #25, conn_id=1) 11:35:53,080 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 11:35:53,080 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-threadNodeA-p406-t6) Updating stable topology for cache dist: CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,080 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-threadNodeA-p406-t6) Updating cluster-wide stable topology for cache dist, topology = CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-threadNodeA-p406-t6) dests=null, command=CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5}, mode=ASYNCHRONOUS, timeout=240000 11:35:53,080 TRACE [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] (remote-threadNodeA-p406-t6) Replication task sending CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5} to single recipient NodeB-51742 with response mode GET_NONE 11:35:53,080 TRACE [org.jgroups.protocols.UNICAST3] (remote-threadNodeA-p406-t6) NodeA-45995 --> DATA(NodeB-51742: #26, conn_id=1) 11:35:53,080 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-threadNodeA-p406-t6) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 11:35:53,080 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5} 11:35:53,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeA-p408-t1) Waiting on view 5 being accepted 11:35:53,080 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 2 msgs (6677 bytes (33385.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeB-51742] 11:35:53,080 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (6636 bytes) 11:35:53,076 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995 <-- DATA(NodeB-51742: #35, conn_id=0) 11:35:53,081 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-3,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=3267 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 11:35:53,081 TRACE [org.jgroups.protocols.TCP_NIO2] (OOB-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (3 headers), size=3268 bytes, flags=OOB|DONT_BUNDLE|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 11:35:53,081 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #26, conn_id=1) 11:35:53,081 TRACE [org.jgroups.protocols.UNICAST3] (OOB-3,NodeB-51742) NodeB-51742: delivering NodeA-45995#26 11:35:53,081 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-3,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:53,081 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742 <-- DATA(NodeA-45995: #25, conn_id=1) 11:35:53,084 TRACE [org.jgroups.protocols.UNICAST3] (OOB-2,NodeA-45995) NodeA-45995: delivering NodeB-51742#35 11:35:53,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (OOB-2,NodeA-45995) Responses: sender=NodeB-51742value=SuccessfulResponse{responseValue=true} , received=true, suspected=false 11:35:53,084 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-threadNodeA-p408-t2) Cluster members updated for cache dist, no abrupt leavers detected: cache members = [NodeA-45995, NodeB-51742]. Existing members = [NodeA-45995, NodeB-51742] 11:35:53,084 TRACE [org.infinispan.partitionhandling.impl.PreferAvailabilityStrategy] (transport-threadNodeA-p408-t2) Cache dist did not lose any members, skipping rebalance 11:35:53,080 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Updating local topology for cache dist: CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,080 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-threadNodeA-p408-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5} 11:35:53,086 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeA-p408-t1) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:53,086 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeA-p408-t1) Installing new cache topology CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:53,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=13, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,086 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t1) Signalling topology 13 is installed 11:35:53,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:53,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) On cache dist we have: added segments: []; removed segments: [] 11:35:53,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Topology update processed, stateTransferTopologyId = 12, startRebalance = false, pending CH = null 11:35:53,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Stop keeping track of changed keys for state transfer 11:35:53,081 TRACE [org.jgroups.protocols.UNICAST3] (OOB-1,NodeB-51742) NodeB-51742: delivering NodeA-45995#25 11:35:53,089 TRACE [org.jgroups.blocks.RequestCorrelator] (OOB-1,NodeB-51742) calling (org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher) with request 0 11:35:53,089 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-1,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=AVAILABLE, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5} [sender=NodeA-45995] 11:35:53,089 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-1,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:53,089 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-threadNodeB-p417-t3) Waiting on view 5 being accepted 11:35:53,089 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t3) Updating local topology for cache dist: CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,089 TRACE [org.infinispan.topology.CacheTopology] (transport-threadNodeB-p417-t3) Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 1 0, 5: 1 0, 6: 0 1, 7: 0 1, 8: 1 0, 9: 1 0, 10: 0 1, 11: 1 0, 12: 1 0, 13: 0 1, 14: 1 0, 15: 1 0, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 0 1, 24: 0 1, 25: 0 1, 26: 1 0, 27: 0 1, 28: 1 0, 29: 1 0, 30: 1 0, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 1 0, 36: 1 0, 37: 1 0, 38: 1 0, 39: 0 1, 40: 0 1, 41: 1 0, 42: 1 0, 43: 0 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1 0, 50: 0 1, 51: 0 1, 52: 0 1, 53: 0 1, 54: 0 1, 55: 1 0, 56: 0 1, 57: 0 1, 58: 1 0, 59: 0 1, 60: 1 0, 61: 0 1, 62: 0 1, 63: 1 0, 64: 0 1, 65: 0 1, 66: 1 0, 67: 0 1, 68: 0 1, 69: 0 1, 70: 0 1, 71: 1 0, 72: 1 0, 73: 1 0, 74: 0 1, 75: 1 0, 76: 0 1, 77: 0 1, 78: 0 1, 79: 0 1, 80: 1 0, 81: 0 1, 82: 1 0, 83: 0 1, 84: 1 0, 85: 0 1, 86: 0 1, 87: 1 0, 88: 0 1, 89: 0 1, 90: 0 1, 91: 1 0, 92: 1 0, 93: 0 1, 94: 0 1, 95: 0 1, 96: 1 0, 97: 1 0, 98: 1 0, 99: 1 0, 100: 1 0, 101: 1 0, 102: 1 0, 103: 1 0, 104: 0 1, 105: 1 0, 106: 0 1, 107: 1 0, 108: 0 1, 109: 0 1, 110: 0 1, 111: 1 0, 112: 0 1, 113: 1 0, 114: 1 0, 115: 0 1, 116: 1 0, 117: 0 1, 118: 0 1, 119: 1 0, 120: 0 1, 121: 1 0, 122: 1 0, 123: 0 1, 124: 0 1, 125: 1 0, 126: 0 1, 127: 1 0, 128: 0 1, 129: 0 1, 130: 0 1, 131: 0 1, 132: 1 0, 133: 0 1, 134: 0 1, 135: 1 0, 136: 1 0, 137: 1 0, 138: 1 0, 139: 0 1, 140: 1 0, 141: 1 0, 142: 0 1, 143: 1 0, 144: 0 1, 145: 0 1, 146: 0 1, 147: 1 0, 148: 0 1, 149: 0 1, 150: 0 1, 151: 1 0, 152: 0 1, 153: 0 1, 154: 0 1, 155: 1 0, 156: 1 0, 157: 0 1, 158: 1 0, 159: 1 0, 160: 0 1, 161: 0 1, 162: 0 1, 163: 0 1, 164: 0 1, 165: 0 1, 166: 1 0, 167: 0 1, 168: 1 0, 169: 1 0, 170: 1 0, 171: 1 0, 172: 0 1, 173: 0 1, 174: 1 0, 175: 0 1, 176: 1 0, 177: 1 0, 178: 1 0, 179: 0 1, 180: 0 1, 181: 1 0, 182: 1 0, 183: 0 1, 184: 0 1, 185: 1 0, 186: 1 0, 187: 0 1, 188: 1 0, 189: 1 0, 190: 1 0, 191: 0 1, 192: 1 0, 193: 1 0, 194: 0 1, 195: 1 0, 196: 0 1, 197: 0 1, 198: 0 1, 199: 1 0, 200: 1 0, 201: 1 0, 202: 1 0, 203: 1 0, 204: 0 1, 205: 1 0, 206: 1 0, 207: 0 1, 208: 1 0, 209: 0 1, 210: 0 1, 211: 1 0, 212: 1 0, 213: 1 0, 214: 0 1, 215: 1 0, 216: 0 1, 217: 1 0, 218: 1 0, 219: 0 1, 220: 0 1, 221: 0 1, 222: 0 1, 223: 1 0, 224: 0 1, 225: 1 0, 226: 0 1, 227: 1 0, 228: 1 0, 229: 1 0, 230: 1 0, 231: 0 1, 232: 1 0, 233: 0 1, 234: 1 0, 235: 1 0, 236: 1 0, 237: 1 0, 238: 1 0, 239: 0 1, 240: 1 0, 241: 1 0, 242: 0 1, 243: 0 1, 244: 1 0, 245: 0 1, 246: 0 1, 247: 1 0, 248: 0 1, 249: 0 1, 250: 0 1, 251: 0 1, 252: 1 0, 253: 0 1, 254: 1 0, 255: 1 0 11:35:53,089 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-threadNodeB-p417-t3) Installing new cache topology CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} on cache dist 11:35:53,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Received new topology for cache dist, isRebalance = false, isMember = true, topology = CacheTopology{id=13, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,089 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (OOB-3,NodeB-51742) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=dist, type=STABLE_TOPOLOGY_UPDATE, sender=NodeA-45995, joinInfo=null, topologyId=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, availabilityMode=null, actualMembers=[NodeA-45995, NodeB-51742], throwable=null, viewId=5} [sender=NodeA-45995] 11:35:53,089 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (OOB-3,NodeB-51742) Added a new task directly: 0 task(s) are waiting 11:35:53,089 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling topology 13 is installed 11:35:53,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 11:35:53,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) On cache dist we have: added segments: []; removed segments: [] 11:35:53,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Topology update processed, stateTransferTopologyId = 12, startRebalance = false, pending CH = null 11:35:53,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Stop keeping track of changed keys for state transfer 11:35:53,086 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:53,090 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeA-p408-t1) Tracking is disabled. Clear tracker: {} 11:35:53,089 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t3) Set track to PUT_FOR_STATE_TRANSFER = false 11:35:53,092 TRACE [org.infinispan.statetransfer.CommitManager] (transport-threadNodeB-p417-t3) Tracking is disabled. Clear tracker: {} 11:35:53,092 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t3) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} with new topology 13 and was pre false 11:35:53,092 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeB-p417-t3) No change listeners present! 11:35:53,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Unlock State Transfer in Progress for topology ID 13 11:35:53,092 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeB-p417-t3) Signalling transaction data received for topology 13 11:35:53,092 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:53,092 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,092 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeB-p417-t3) Removing no longer owned entries for cache dist 11:35:53,092 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Topology changed, recalculating minTopologyId 11:35:53,092 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeB-p417-t3) Changing minimum topology ID from 12 to 13 11:35:53,092 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeB-p417-t3) Updating stable topology for cache dist: CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,090 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t1) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 131+125, NodeB-51742: 125+131]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]} with new topology 13 and was pre false 11:35:53,095 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-threadNodeA-p408-t1) No change listeners present! 11:35:53,095 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Unlock State Transfer in Progress for topology ID 13 11:35:53,095 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-threadNodeA-p408-t1) Signalling transaction data received for topology 13 11:35:53,095 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Checking for transactions originated on leavers. Current cache members are [NodeA-45995, NodeB-51742], remote transactions: 0 11:35:53,095 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) No remote transactions pertain to originator(s) who have left the cluster. 11:35:53,095 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-threadNodeA-p408-t1) Removing no longer owned entries for cache dist 11:35:53,095 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Topology changed, recalculating minTopologyId 11:35:53,095 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-threadNodeA-p408-t1) Changing minimum topology ID from 12 to 13 11:35:53,095 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-threadNodeA-p408-t1) Updating stable topology for cache dist: CacheTopology{id=13, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (2)[NodeA-45995: 134+122, NodeB-51742: 122+134]}, pendingCH=null, unionCH=null, actualMembers=[NodeA-45995, NodeB-51742], persistentUUIDs=[7b0eab6e-85dc-4af1-b423-5186b3cfc4d8, 748c0a51-6c51-4aa1-8769-895b223ff294]} 11:35:53,167 TRACE [org.infinispan.test.TestingUtil] (testng) Node NodeA-45995 finished state transfer. 11:35:53,169 TRACE [org.infinispan.test.TestingUtil] (testng) Node NodeB-51742 finished state transfer. 11:35:53,169 INFO [org.infinispan.distribution.rehash. (testng) Rehash complete 11:35:53,169 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command GetKeyValueCommand {key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4baff410] 11:35:53,169 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:53,173 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} 11:35:53,173 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Wrap MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} for read. Entry=ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} 11:35:53,180 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: GetKeyValueCommand 11:35:53,180 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command GetKeyValueCommand {key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@7aaf7cb3] 11:35:53,180 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:53,180 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} 11:35:53,181 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Wrap MagicKey#k1{18/E4FAB6DD/194@NodeA-45995} for read. Entry=ImmortalCacheEntry{key=MagicKey#k1{18/E4FAB6DD/194@NodeA-45995}, value=v1} 11:35:53,181 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: GetKeyValueCommand 11:35:53,281 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command GetKeyValueCommand {key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@79b13962] 11:35:53,281 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:53,281 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container ImmortalCacheEntry{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2} 11:35:53,281 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Wrap MagicKey#k2{19/D9F36386/122@NodeB-51742} for read. Entry=ImmortalCacheEntry{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2} 11:35:53,281 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: GetKeyValueCommand 11:35:53,281 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command GetKeyValueCommand {key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@38d8765f] 11:35:53,281 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:53,281 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container ImmortalCacheEntry{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2} 11:35:53,281 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Wrap MagicKey#k2{19/D9F36386/122@NodeB-51742} for read. Entry=ImmortalCacheEntry{key=MagicKey#k2{19/D9F36386/122@NodeB-51742}, value=v2} 11:35:53,298 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: GetKeyValueCommand 11:35:53,298 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeD-43076: #25) 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeD-43076, src=NodeA-45995, headers are UNICAST3: ACK, seqno=25, ts=15, TP: [cluster_name=ISPN] 11:35:53,302 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeC-21874: #18) 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeC-21874, src=NodeA-45995, headers are UNICAST3: ACK, seqno=18, ts=16, TP: [cluster_name=ISPN] 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8303 (63 bytes) 11:35:53,302 TRACE [org.jgroups.protocols.UNICAST3] (Timer-3,NodeA-45995) NodeA-45995 --> ACK(NodeB-51742: #35) 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-3,NodeA-45995) NodeA-45995: sending msg to NodeB-51742, src=NodeA-45995, headers are UNICAST3: ACK, seqno=35, ts=17, TP: [cluster_name=ISPN] 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) 127.0.0.1:8300: connecting to 127.0.0.1:8303 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) 127.0.0.1:8300: removed connection to 127.0.0.1:8303 11:35:53,302 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) NodeA-45995: sending 2 msgs (120 bytes (600.00% of max_bundle_size) to 2 dests(s): [ISPN:NodeC-21874, ISPN:NodeB-51742] 11:35:53,303 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8302 (63 bytes) 11:35:53,303 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) 127.0.0.1:8300: connecting to 127.0.0.1:8302 11:35:53,303 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) 127.0.0.1:8300: removed connection to 127.0.0.1:8302 11:35:53,306 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeA-45995) dest=127.0.0.1:8301 (63 bytes) 11:35:53,308 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-1,NodeB-51742) NodeB-51742: received [dst: NodeB-51742, src: NodeA-45995 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=35, ts=17, TP: [cluster_name=ISPN] 11:35:53,308 TRACE [org.jgroups.protocols.UNICAST3] (INT-1,NodeB-51742) NodeB-51742 <-- ACK(NodeA-45995: #35, conn-id=0, ts=17) 11:35:53,398 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command GetKeyValueCommand {key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@ce30a20] 11:35:53,398 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:53,403 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} 11:35:53,403 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Wrap MagicKey#k3{1A/92BE3B55/33@NodeC-21874} for read. Entry=ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} 11:35:53,403 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: GetKeyValueCommand 11:35:53,403 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (testng) Invoked with command GetKeyValueCommand {key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, flags=[]} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@d28a5eb] 11:35:53,404 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Exists in context? null 11:35:53,404 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Retrieved from container ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} 11:35:53,404 TRACE [org.infinispan.container.EntryFactoryImpl] (testng) Wrap MagicKey#k3{1A/92BE3B55/33@NodeC-21874} for read. Entry=ImmortalCacheEntry{key=MagicKey#k3{1A/92BE3B55/33@NodeC-21874}, value=v3} 11:35:53,404 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (testng) Invoking: GetKeyValueCommand 11:35:53,425 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeB-51742) NodeB-51742 --> ACK(NodeA-45995: #26) 11:35:53,425 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeB-51742) NodeB-51742: sending msg to NodeA-45995, src=NodeB-51742, headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=8, TP: [cluster_name=ISPN] 11:35:53,425 TRACE [org.jgroups.protocols.UNICAST3] (Timer-2,NodeB-51742) NodeB-51742 --> XMIT(NodeD-43076: #10) 11:35:53,425 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (60 bytes (300.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeA-45995] 11:35:53,425 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer-2,NodeB-51742) NodeB-51742: sending msg to NodeD-43076, src=NodeB-51742, headers are RequestCorrelator: corr_id=200, type=REQ, req_id=0, rsp_expected=false, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 11:35:53,430 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8300 (63 bytes) 11:35:53,432 TRACE [org.jgroups.protocols.TCP_NIO2] (INT-2,NodeA-45995) NodeA-45995: received [dst: NodeA-45995, src: NodeB-51742 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=26, conn_id=1, ts=8, TP: [cluster_name=ISPN] 11:35:53,432 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) NodeB-51742: sending 1 msgs (319 bytes (1595.00% of max_bundle_size) to 1 dests(s): [ISPN:NodeD-43076] 11:35:53,435 TRACE [org.jgroups.protocols.UNICAST3] (INT-2,NodeA-45995) NodeA-45995 <-- ACK(NodeB-51742: #26, conn-id=1, ts=8) 11:35:53,436 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) dest=127.0.0.1:8303 (322 bytes) 11:35:53,436 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) 127.0.0.1:8301: connecting to 127.0.0.1:8303 11:35:53,436 TRACE [org.jgroups.protocols.TCP_NIO2] (TransferQueueBundler,NodeB-51742) 127.0.0.1:8301: removed connection to 127.0.0.1:8303 [TestSuiteProgress] Test failed: org.infinispan.distribution.rehash.